FLEXIBILITY  AND  DECISION  ANALYSIS 
Miley  Wesson  Merkhofer 
Stanford  University 


AD-A015  290 


Prepared  for: 

Office  of  Naval  Research 
National  Science  Foundation 
Advanced  Research  Projects  Agency 


30  June  1975 


DISTRIBUTED  BY: 


National  Technical  Information  Service 
U.  S.  DEPARTMENT  OF  COMMERCE 


Research  Report  No.  EES-DA-75-1 
June  30,  1975 


FLEXIBILITY  AMD  DECISION  ANALYSIS 

Miley  Wesson  Merkhofer 


DECISION  ANALYSIS  PROGRAM 

Professor  Ronald  A.  Howard 
Principal  Investigator 


DEPARTMENT  OF  ENGINEERING-ECONOMIC  SYSTEMS 

Stanford  University 
Stanford,  California  94305 


Reproduced  by 

NATIONAL  TECHNICAL 
INFORMATION  SERVICE 

US  Departmcnf  of  Commoreo 
Springfield.  VA.  22151 


SPONSORSHIPS 

Advanced  Research  Projects  Agency,  Human  Resources  Research  Office, 
hRPA  Order  No.  2449,  monitored  by  Engineering  Psychology  Programs, 

Office  of  Naval  Research,  Contract  No.  N0001 4-67 -A-01 12-0077 
(NR1 97-024). 

National  Science  Foundation,  NSF  Grant  GK-36491 . 

This  document  has  been  approved  for  public  release.  Reproduction  in  whole 
or  in  part  is  permitted  for  any  purpose  of  the  United  States  Government. 


!>#» N 

o 

CM 

lO 

rH 

O 

< 

o 


SECUR'Ty  CL  ASSI  FiC  A 'ION  Or  This  PAGE  fWTixn  Pete  Fritted) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 

1 REPORT  number  iJ  gov/t  accession  no 

EES-DA-7  5-1 

3 RF  LIPIEN*'S  CATALOG  NUMBER 

4 TITLE  (end  Submit) 

"Flexibility  and  Decision  Analysis" 

5 TYPE  OF  REPORT  b PERIOD  COVERED 

Technical 
5/1/73  to  5/31/75 

6 PERFORMING  ORG.  REPORT  NUMBER 

7 AUTHOPr.*) 

Mi ley  Wesson  Merkhofer 

0 CONTRACT  on  GRANT  MUMDERfM 

N0001 4-67-A-01 12-0077 

9 PEHEORMING  ORGANIZATION  NAME  AND  ADORESS 

The  Board  of  Trustees  of  the  Lei  and  Stanford 
Junior  University,  c/o  Office  of  Research  Admin- 
istrator, tncina  Hall,  Stanford,  California  94305 

10  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  « WORK  UNIT  NUMBERS 

oooooo  ! 

ARPA  Order  #2449 

'I  CON  TROLLING  OFFICE  NAME  AND  ADORESS 

Advanced  Research  Projects  Agency 

Human  Resources  Research  Office 

1400  Wilson  Blvd.,  Arlinqton,  Virqinia  2220S 

12.  REPORT  DATE 

June  30,  1975 

13.  number  of  pages 

132  pages 

14  MPNlTOPINC  A!'.  FNCV  NAME  a ADDRESS///  dlllrrent  Iron  CnntrnlUnt  ntlire) 

Engineering  Psychology  Programs,  Code  455 
Office  of  Naval  Research 

800  No.  Quincy  Street,  Arlington,  Virginia  22217 

IS  SFCUBITY  CLASS,  (ol  tbit  report) 

Unclassified 

IS.  DECLASSIFICATION  DOWNGRADING 

schedule 

16  Distribution  statement  /n/  t/i/«  Rfpn«j  / 

O 

Approved  for  public  release;  distribution  unlimited.  ^ r-~..  ■, .-'AW 

17  DISTRIBUTION  STATEMENT  (o  1 Ih e ehstreet  entered  In  Block  30.  II  dlllerent  from  Report)  Y\\\  \)  C \ \ 

IB  SUPPLEMENTARY  NOTES 

A dissertation  submitted  to  the  Department  of  Engineering -Economic  Systems 
and  the  Committee  on  Graduate  Studies  of  Stanford  University  in  partial 
fulfillment  of  the  Requirements  for  the  Degree  of  Doctor  of  Philosophy, 

June  1975.  

19  KEY  *>0°DS  fCanttmt*  on  r<“v®r.%*  ride  //  n*e*i*ary  and  htenl'fv  tv  block  number) 

DECISION  ANALYSIS  VALUE  OF  INFORMATION  QUANTIZATION 

DECISION  FLEXIBILITY  VALUE  OF  FLEXIBILITY  QUADRATIC  PROBLEM 

20  ABSTRACT  (Continue  on  reuertm  tide  II  nec emery  end  Identity  by  block  number) 

The  notion  that  a good  decision  strategy  is  a flexible  one  has  long  been 
intuitively  appreciated  by  decision  makers.  Decision  analysis,  however,  has 
j had  little  to  say  on  the  subject  of  flexibility.  The  purpose  of  this  thesis 
is  to  place  the  flexibility  concept  within  the  decision  analysis  framework. 

The  analysis  begins  with  an  application  of  decision  theory  techniques  to  the 
problem  of  chocsing  between  flexible  and  inflexible  decision  strategies. 

(Continued  on  reverse  side) 

DD  , :°:“3  1473  EDITION  OF  I NOV  US  IS  OBSOLETE  UNCLASSIFIED 

I SECURITY  CLASSIFICATION  of  this  PAGE  flWirn  Detm  FniTfd) 


SECURITY  CL  ASSI  FlC  ATIQH  OF  THU  RAOECRTti  Dmtm  Mnlttjd) 


Block  20  (continued) 

A precise  mathematical  definition  of  decision  flexibility  is  proposed 
wherein  the  relative  flexibility  of  a decision  is  measured  by  the  size  of 
the  decision  choice  set.  Further  application  of  the  theory  of  decision 
analysis  provides  a measure  of  the  value  of  flexibility. 

A strong  complementarity  between  information  and  flexibility  is  observed. 
The  more  information  is  expected  during  the  execution  of  a plan,  the  more 
valuable  is  flexibility.  Conversely,  the  more  flexibility  one  has,  the 
greater  the  value  of  information  gathering.  The  concepts  of  the  value  of 
information  and  the  value  of  flexibility  are  seen  to  be  inseparable.  We 
define  a more  fundamental  concept  of  the  value  of  information  given 
flexibility  and  point  out  the  applications  of  the  concept  to  decision 
making. 

The  value  of  information  given  flexibility  is  analyzed  for  decision 
problems  with  quadratic  value  functions.  The  restriction  to  this  class 
allows  us  to  isolate  the  impact  of  tvo  characteristics  that  in  a large 
part  determine  tne  economic  impact  or  information  and  flexibility.  These 
are  (1)  the  extent  of  correlation  among  the  state  and  information 
variables  and  (2)  the  amount  of  interaction  among  the  decision  variables. 

A portion  of  the  thesis  is  devoted  to  a study  of  the  effects  of  the 
information  and  flexibility  quantization  necessary  for  a decision  tree 
representation  of  a sequential  decision  problem.  The  analysis  indicates 
that  even  a very  rough  system  of  quantization  tends  to  introduce  only  small 
losses  into  the  optimal  solution  of  a sequential  decision  problem.  Thus, 
support  is  given  to  the  method  of  solution  of  sequential  problems  by 
decision  trees. 

Finally,  methods  are  presented  for  simplifying  the  calculation  of  the 
value  of  information  given  flexibility  through  the  use  of  sensitivity 
analysis. 


II 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGEflWiFn  D»r»  Enfrtd) 


W^*W?’  **’*&$‘ 


ABSTRACT 


The  notion  that  a good  decision  strategy  is  a flexible  one  has 
long  been  intuitively  appreciated  by  decision  makers.  Decision  analy- 
sis, however,  has  had  little  to  say  on  the  subject  of  flexibility. 

The  purpose  of  this  thesis  is  to  place  the  flexibility  concept  within 
the  decision  analysis  framework. 

The  analysis  begins  with  an  application  of  decision  theory  tech- 
niques to  the  problem  of  choosing  between  flexible  and  inflexible  deci- 
sion strategies.  A precise  mathematical  definition  of  decision  flex- 


ibility is  proposed  wherein  the  relative  flexibility  of  a decision  is 
measured  by  the  size  of  the  decision  choice  set.  Further  application 
of  the  theory  of  decision  analysis  provides  a measure  of  the  value  of 
flexibility. 

A strong  complementarity  between  information  and  flexibility  is 
observed.  The  more  information  is  expected  during  the  execution  of  a 
plan,  the  more  valuable  is  flexibility.  Conversely,  the  more  flexi- 
bility one  has,  the  greater  the  value  of  information  gathering.  The 
concepts  of  the  value  of  information  and  the  value  of  flexibility  are 
seen  to  be  inseparable.  We  define  a more  fundamental  concept  of  the 
value  of  information  given  flexibility  and  point  out  the  applications 
of  the  concept  to  decision  making. 

The  value  of  information  given  flexibility  is  analyzed  for  deci- 
sion problems  with  quadratic  value  functions.  The  restriction  to  this 
class  allows  us  to  isolate  the  impact  of  two  characteristics  that  in 
a large  part  determine  the  economic  impact  of  information  and  flexi- 
bility. These  are  (1)  the  extent  of  correlation  among  the  state  and 
information  variables  and  (2)  the  amount  of  interaction  among  the 
decision  variables. 

A portion  of  the  thesis  is  devoted  to  a study  of  the  effects 
of  the  information  and  flexibility  quantization  necessary  for  a deci- 
sion tree  representation  of  a sequential  decision  problem.  The  anal- 
ysis indicates  that  even  a very  rough  system  of  quantization  tends 
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to  introduce  only  small  losses  into  the  optimal  solution  of  a 
sequential  decision  problem.  Thus,  support  is  given  to  the  method 
of  solution  of  sequential  problems  by  decision  trees. 

Finally,  methods  are  presented  for  simplifying  the  calculation 
of  the  value  of  information  given  flexibility  through  the  use  of 
sensitivity  analysis. 
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INTRODUCTION  AND  SUMMARY  OF  RESULTS 

In  the  course  of  the  scientific  development  of  the  theory  of 
decision-making,  it  often  has  been  the  case  that  substantial  improve- 
ments in  understanding  have  resulted  from  the  mathematical  refinement 
of  common  terms.  Words  such  as  "uncertainty,"  "risk,"  and  "information" 
have  everyday  meanings  that  fail  to  distinguish  adequately  a problem's 
characteristics.  Consequently  for  the  purposes  of  economic  analysis, 
their  definitions  have  been  narrowed,  or  they  have  been  replaced  by  new 
terms  whose  meanings  are  more  precise. 

The  objective  of  this  thesis  is  to  present  a mathematically  pre- 
cise definition  of  the  term  "flexibility"  appropriate  to  the  discipline 
of  decision  analysis.  We  believe  that  an  important  measure  of  the  ap- 
propriateness of  a definition  should  be  the  worth  of  the  insights 
generated  from  its  use.  Consequently,  a major  portion  of  our  work  is 
an  exploration  for  useful  results  that  may  be  derived  from  the  applica- 
tion of  our  definition. 

Chapter  1 

Chapter  1 presents  our  definition  of  decision  flexibility.  We  view 
the  flexibility  of  a given  decision  variable  to  be  determined  by  the 
size  of  the  choice  set  associated  with  that  variable.  Roughly  speaking, 
the  larger  the  choice  set-- that  is,  the  more  alternatives  that  are 
available  for  a decision-- the  greater  is  the  decision  flexibility. 

Since  flexibility  is  a property  of  the  choice  set  for  a variable 
rather  than  a property  of  the  variable  itself,  the  degree  of  flexibil- 
ity possessed  by  each  decision  will  change  during  the  decision  process. 
The  actions  taken  early  in  a decision  process  often  affect  the  number 
of  alternatives  available  later  on.  The  action  to  acquire  a choice  set 
is  a decision  that  produces  flexibility  on  another  variable.  Thus, 
the  decision  to  keep  a large  amount  of  cash  in  your  checking  account  is 
not,  by  our  definition,  necessarily  a flexible  decision.  Rather,  it  is 
this  decision  that  increases  our  subsequent  flexibility  for  the  deci- 
sion of  what  we  purchase  by  check.  On  the  other  hand,  the  irreversible 
commitment  of  a decision  variable  to  a specific  alternative  eliminates 
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the  flexibility  associated  with  that  variable.  Prior  to  zeroing  out 
one's  checking  account,  the  decision  to  buy  either  a set  of  golf  clubs 
or  a new  dishwasher  is  still  flexible.  However,  the  minute  we  hand 
over  the  check  in  the  sporting  goods  store  that  decision  becomes  in- 
flexible . 

Chapter  2 

Chapter  2 is  concerned  with  placing  an  economic  value  on  maintain- 
ing a given  amount  of  decision  flexibility.  The  value  of  flexibility, 
however,  is  strongly  dependent  upon  the  information  that  might  be  re- 
ceived during  the  decision  process.  The  more  a decision  maker  expects 
to  learn  in  the  course  of  a decision,  the  more  it  pays  to  follow  flex- 
ible decision  strategies.  Conversely,  the  more  flexible  one's  decision 
strategy,  the  greater  the  value  of  information-gathering.  Thus,  the 
concepts  of  value  of  information  and  value  of  flexibility  become  spe- 
cial cases  of  the  more  general  concept  of  the  value  of  information 
given  flexibility. 

The  value  of  information  given  flexibility  measures  the  value  to 
the  decision  maker,  in  economic  units,  of  obtaining  a given  amount  of 
information  together  with  a given  amount  of  decision  flexibility.  An 
upper  limit  to  this  quantity,  the  expected  valui  ?f  perfect  information 
given  perfect  flexibility  (EVPIGPF) , may  be  calculated.  The  method 
deviates  only  slightly  from  the  standard  decision  theory  calculation  of 
the  expected  value  of  perfect  information  (EVPI) . 

The  EVPIGPF  is  similar  to,  but  more  complete  than,  the  concept  of 
EVPI.  Whereas  EVPI  measures  the  value  of  perfect  information  under  the 
assumption  that  all  decision  variables  may  be  adjusted  to  utilize  the 
information,  the  EVPIGPF  explicitly  states  which  decision  variables  may 
be  adjusted  in  response  to  what  information.  In  a real  system  it  may 
be  costly  or  impossible  to  maintain  flexibility  on  all  decisions  while 
awaiting  the  arrival  of  some  piece  of  information.  By  comparing  the 
costs  of  maintaining  flexibility  with  the  EVPIGPF,  the  decision  maker 
has  a method  for  deciding  which  decisions  ought  to  be  kept  flexible  and 
on  which  it  is  more  profitable  to  eliminate  flexibility. 
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Chapter  3 

Chapter  3 calculates  the  EVPIGPF  for  a particular  class  of  decision 
problems  that  we  call  quadratic.  Quadratic  decisions  may  be  thought  of 
as  approximations  to  a much  broader  class  of  problems  characterized  by 
decision  and  uncertain  outcome  variables  that  may  take  on  a continuum 
of  values.  The  exploration  identifies  the  influence  of  a number  of 
problem  parameters  on  the  value  of  obtaining  information  with  decision 
flexibility.  One  of  these  parameters  is  the  degree  of  interaction 
among  the  problem  decision  variables.  Specifically,  if  v represents 
the  value  of  a particular  outcome  of  a decision,  the  degree  of  interac- 
tion between  a decision  variable  d.  and  a decision  variable  d is 

1 2 J 

measured  by  the  second  partial  der'vative  o v/od.^d.  . This  deriva- 

tive  gives  the  degree  to  which  a change  in  decision  variable  d in- 
„ J 

fluences  the  effect  of  a change  in  dec  is  ion  variable  d.  on  outcome 

i 

value . 

An  interesting  result  of  Chapter  3 states  that  to  a first  order 
approximation  the  value  of  obtaining  information  on  one  uncertain  quan- 
tity  plus  the  value  of  obtaining  information  on  another  uncertain  quan- 


tity will  equal  the  value  of  obtaining  information  on  both  quantities 
simultaneously,  only  provided  that  the  information  is  uncorrelated; 
that  is,  provided  that  learning  one  quantity  does  not  help  us  in  learn- 
ing the  other.  Similarly,  the  value  of  obtaining  flexibility  on  one 
decision  plus  the  value  of  obtaining  flexibility  on  another  decision 
will,  to  a first  approximation,  equal  the  value  of  obtaining  flexibil- 
ity jointly,  only  provided  that  the  two  decisions  do  not  interact. 


Chapter  4 

One  of  the  most  common  methods  for  analyzing  decision  problems  is 
the  decision  tree.  In  a decision  tree  information  and  flexibility  are 
represented  as  quantized  or  discretized  approximations  by  branches  ema- 
nating from  nodes  in  a tree- like  structure.  Chapter  4 is  concerned 
with  the  effect  of  such  quantization  on  the  value  of  information  given 
flexibility.  A method  is  presented  for  determining  the  precise  econo- 
mic loss  to  be  expected  from  using  a quantized  rather  than  an  exact  in- 
formation reporting  system.  In  addition,  the  possibility  of  designing 
optimal  quantizing  systems  is  demonstrated. 
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Once  again,  an  analysis  is  conducted  on  the  special  class  of  qua- 
dratic problems.  For  the  two- variable  quadratic  problem,  which  contains 
a single  decision  and  a single  uncertain  outcome,  the  expected  economic 
loss  from  information  quantization  or  flexibility  discretization  is  in- 
vestigated for  several  different  probability  distributions  describing 
the  uncertain  outcome.  Expected  loss  is  found  to  be  relatively  insen- 
sitive to  the  particular  quantizing  or  discretizing  system  chosen. 
Invariably,  the  expected  economic  loss  falls  quickly  with  the  number  of 
quantizing  or  discretizing  levels  employed:  roughly  60%  of  the  value 

of  information  or  60%  of  the  value  of  flexibility  may  be  obtained  using 
only  two  levels,  and  807..  of  the  value  may  be  expected  using  three  lev- 
els. The  implication  is  that  information  and  flexibility  are  well  rep- 
resented in  a decision  tree  by  as  few  as  three  branches  from  respective 
state  or  decision  nodes. 

Chapter  5 

Chapter  5 incorporates  the  flexibility  concept  into  a useful  tech- 
nique for  decision  model  design  and  analysis  called  "sensitivity  analy- 
sis." One  form  of  sensitivity  analysis  is  proximal  analysis.  Proximal 
analysis  assumes  that  the  decision  problem  is  approximately  quadratic. 
Thus,  the  thesis  results  concerning  the  quadratic  decision  problem  are 
directly  applicable  here.  The  main  results  of  Chapter  5 provide  tech- 
niques for  more  easily  estimating  the  EVPIGPF  under  the  assumptions  of 
the  proximal  model. 


1 


i 


-4- 


CHAPTER  1 

THE  CONCEPT  OF  FLEXIBILITY 


Nearly  everyone  is  familiar  with  the  story  of  a plan  that  went 
wrong  because  it  failed  to  adjust  for  some  unforeseen  circumstance. 

We  might  say  that  such  a plan  lacked  flexibility,  that  a good  decision 
strategy  is  a flexible  one.  However,  what  exactly  do  we  mean  by  deci- 
sion flexibility? 

1.1  LITERATURE 

If  one  turns  to  micro-economic  literature  on  the  theory  of  the 
firm, one  will  uncover  a number  of  definitions  for  decision  flexibility. 
For  most  authors  flexibility  is,  roughly  speaking,  a property  of  a de- 
cision which  makes  it  easily  altered.  Hart  [6]  and  Theil  [14]  define 
flexible  decision  rules  as  dynamic,  inflexible  decision  rules  as  sta- 
tic. From  their  point  of  view  if  a production  plant  is  flexible,  it 
is  possible  to  diverge  from  planned  values  at  a date  subsequent  to  their 
acceptance.  Hence,  flexibility  refers  to  the  ability  to  modify  plans 
over  time.  Marschak  and  Nelson  [10]  are  more  specific.  For  them  flex- 
ibility is  a property  of  an  initial  decision  which  makes  subsequent  ac- 
tions less  costly  or  preserves  more  choices.  Stigler  [13]  and  Baumoi 
[1]  refer  to  flexibility  in  the  context  of  static  decision-making; 
for  them  it  means  the  rate  of  change  of  marginal  cost.  The  smaller  a 
plant's  second  derivative  of  total  cost,  the  more  flexibility  it  has. 
Tisdell  [15]  illustrates  the  importance  of  distinguishing  among  the 
various  definitions  of  flexibility  by  demonstrating  that  they  may  have 
conflicting  consequences  for  decision-making. 

In  each  case  the  meanings  authors  have  ascribed  to  the  term  flex- 
ibility have  been  appropriate  only  within  the  relatively  narrow  con- 
texts of  their  particular  problems.  The  objective  of  Chapter  1 is  to 
present  a mathematically  precise  definition  which  is  applicable  to  a 
much  broader  class  of  problems. 

1.2  DECISION  ANALYSIS 

For  our  definition  and  subsequent  exploration  of  flexibility  we 
shall  rely  upon  the  theory  of  decision  analysis  [7,9].  Decision 
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analysis  is  a practical  discipline  combining  the  techniques  of  decision 
theory  with  the  mathematical  methods  of  svs  terns  analysis . Decision 
theory  is  a logical  means  for  formulating  decision  strategies  under  un- 
certainty. 

We  define  a decision  ac tion  to  be  a commitment  of  scarce  resources 
that  is  irrevocable  in  the  sense  that  it  cannot  be  subsequently  altered 
without  incurring  a nontrivial  penalty.  A decision  strategy  is  defined 
as  a deliberate  selection  of  a specific  decision  action  fro.n  the  set  of 
alternative  actions.  If  this  choice  of  action  is  made  without  knowing 
the  precise  consequences  of  selecting  at  least  one  of  the  alternative 
actions,  we  face  a decision  under  uncertainty. 

Both  the  techniques  of  decision  theory  and  the  concept  of  fl  xibil- 
ity  will  be  made  clearer  by  the  analysis  of  an  example. 

Example:  The  Sofa  Sale 

A your g housewife  named  Linda  thought  she  had  found  the  perfect 
sofa  for  the  apartment,  and  at  one- half  the  usual  price.  "Now  if 
only  Jim  likes  it,"  she  thought,  and  she  couldn't  wait  to  show  it  to  her 
husband.  "I'm  sorry  lady,"  apologized  the  salesman,  "that  model  has 
been  selling  like  hotcakes.  We've  only  got  one  left.  I can't  hold  it 
'til  Saturday  for  you  without  a $25  deposit,  sto  ' rules."  "What  should 
I do?"  Linda  thought.  "I'm  almost  sure  Jim  will  like  it,  but  I cer- 
tainly can't  buy  a sofa  without  his  seeing  it  first."  Just  as  she  was 
pondering  her  situation  she  overheard  an  excited  conversation  between 
two  elderly  women,  "Oh,  look  at  that  lovely  sofa.'  Wouldn't  that  be 
just  perfect  for  cur  den?"  "Why  yes,  Martha,  I believe  you're  right.'" 

The  only  way  that  Linda  can  retain  flexibility  on  her  decision 
whether  or  not  to  buy  the  sofa  is  to  make  the  $25  deposit.  Let's  ima- 
gine that  she  decides  to  analyze  the  problem  using  some  techniques  of 
decision  analysis.  She  observes  that  there  are  three  possible  outcomes 
to  her  problem.  If  she  makes  the  deposit,  she  and  her  husband  could 
decide  (a)  to  purchase  the  sofa,  or  (b)  not  to  purchase  it.  If  she 
does  not  make  the  deposit,  she  reasons,  it  will  certainly  be  sold  be- 
fore Saturday,  Let  us  assume  that  Linda  is  able  to  rank  preferen- 
tially these  three  possible  outcomes  and  express  this  ranking  in  a 
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numerical  fashion.  In  other  words,  we  assume  that  she  defines  a util- 
ity function  over  the  set  of  possible  outcomes.  Figure  l.l  shows  the 
specific  utilities  U for  *his  example. 

While  Linda  has  control  over  the  decision  of  whether  or  not  to 
make  the  deposit,  she  does  not  (for  the  purposes  of  this  example,  at 
least)  have  control  over  whether  or  not  her  husband  will  want  to  pur- 
chase the  sofa.  The  decision  whether  or  not  to  make  the  deposit  and 
the  ultimate  decision  of  whether  or  not  to  purchase  the  sofa  are  con- 
trollable and,  therefore,  designated  decision  variables.  Uncontrol- 
lable determinants  of  outcome  (in  this  case  the  opinion  of  Linda's  hus- 
band) are  generally  called  state  ' "iriables.  While  the  decision  maker 
does  not  know  which  state  will  occi  , she  does  know  which  state  is 
likely  to  occur.  We  assume  that  she  expresses  this  knowledge  in  terms 
of  a probability  distribution  defined  over  the  possible  states.  In 
other  words,  Linda  encodes  her  estimation  as  to  the  likelihood  of  state 
occurrence  in  a probability  function.  In  the  present  example  we  assume 
a probability  of  .8  that  the  state,  "Jim  likes  sofa,"  will  occur  and  a 
probability  of  .2  that  the  state,  "Jim  doesn't  like  sera,"  will  occur. 


DECISION 
A LTESNATIVES 

STATE  VARIABLE  OUTCOMES 

JIM  LIKES  SOE  A 

J'M  DOESN'T  LIKE  SOFA 

MAKE 

DEPOSIT 

DEPOSIT  MADE. 
SOFA  BOUGHT 
U - 2 

DFPOSIT  MADE. 
SOFA  NOT  BOUGHT 
U - -0.5 

DON'T  MAKE 
DEPOSIT 

DEPOSIT  N 
SOFA  not 
U 

OT  MADE. 
BOUGHT 
0 

FIGURE  1 1 POSSIBLE  OUTCOMES  AMD  THEIR  UTILITIES  FOR  THE  SOFA  SALE  EXAMPLE 


This  completes  the  necessary  specification  in  the  problem.  The 
decision  maker  has  specified  the  alternative  actions  and  uncontrol- 
lable states  in  a mutually  exclusive  and  exhaustive  fashion.  Subjec- 
tive probabilities  have  been  assigned  to  state  occurrences,  and  each 
conceivable  outcome-- that  is,  each  possible  combination  of  action  and 
state-- is  described  with  an  appropriate  utility  measurement.  The  de- 
cision structure  is  summarized  in  "tree"  form  in  Fig.  1.2. 

Now,  according  to  the  fundamental  theorem  of  decision  theory, 
the  best  action  alternative  is  the  one  with  the  highest  expec ted  util- 
ity . The  expected  utility  of  a given  action  is  defined  to  be  the  sum, 
over  all  possible  states,  of  the  utilities  of  the  state  conditioned 
outcomes  multiplied  by  the  probabilities  of  the  corresponding  states. 
The  expected  utility  of  the  "make  deposit"  alternative  is,  therefore, 


LINDA'S 

ALTERNATIVE  JIM'S  ULTIMATE  OUTCOME 

ACTIONS  REACTION  DECISION  UTILITIES 


FIGURE  1.?  LINDA'S  DECISION  TREE 
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E ("make  deposit")  ■ Prob("Jim  Likes  sofa")  x U("buy  sofa") 

+ Prob("Jim  doesn't  like  sofa") 
x U("don't  buy  sofa") 

= .8  x 2 + .2  x (-.5)  = 1.5  units  . (1.2.1) 

Since  this  exceeds  the  expected  utility  of  the  "don't  make  deposit" 
alternative  (0  units),  the  best  alternative  given  these  action  alterna- 
tives, states,  probabilities,  and  utilities  of  outcomes  is  to  make  the 
deposit.  In  this  case  the  cost  of  retaining  flexibility  on  the  decision 
to  buy  the  sofa  is  well  worth  the  expected  gain. 

A BASIC  DECISION  MODEL 

The  example  of  this  section  illustrated  some  of  the  essential  fea- 
tures of  decision  analysis.  Given  an  uncertain  choice  situation,  the 
decision  analyst  performs  a decomposition  of  the  problem,  usually  fol- 
lowing a procedure  symbolized  by  the  flow  graph  shown  in  Fig.  1.3.  In 
a deterministic  phase  he  specifies  the  alternative  actions,  states,  and 
outcomes  relevant  to  the  problem  and  assigns  dollar  values  to  the  out- 
comes. In  a probab- cistic  phase  he  encodes  the  decision  maker's  uncer- 
tainties on  the  state  variables  in  a subjective  probability  distribution 
and  his  feelings  cowards  risk  in  a utility  function.  Finally,  an  infor- 
mational phase  may  be  executed  in  which  calculations  of  the  value  of 
gathering  additional  information  are  made.  At  this  point  either  an 
optimal  action  alternative  is  chosen,  or  the  decision  is  made  to  gather 
further  information  and  the  cycle  is  repeated. 


FIGURE  1.3  THE  DECISION  ANALYSIS  CYCLE 
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A Static  Model 


If  no  additional  information  is  anticipated  to  become  available  in 
the  course  of  the  decision  process,  the  choice  of  decision  action  must 
be  based  solely  on  the  decision  maker's  current  state  of  experience.  In 
this  simplest  case  there  are  five  essential  components  of  the  decision 
maker's  resource  commitment  problem.  These  are: 

1.  A feasible  set  D of  mutually  exclusive  and  exhaustive  decision 
action  vectors  d = (d^...^)  . One  and  only  one  _d  s D must 
be  selected. 

2.  An  appropriate  set  S of  mutually  exclusive  and  exhaustive  state 
vectors  j>  ■ (s^,...,sn)  . One  and  only  one  s e S will  occur. 

3.  A probability  distribution  F defined  on  S which  consistently 
describes  the  decision  maker's  feelings  about  the  likelihood  of 
various  states  occurring.  Usually  F is  assumed  to  be  indepen- 
dent of  the  decision  _d  . 

4.  A value  function  v(-,-)  defined  on  the  Cartesian  product  of  the 
sets  S and  D that  describes  the  decision  maker's  assessment 
of  the  dollar  value  of  each  combination  of  decision  alternative 
and  state.  Since  each  outcome  is  described  by  a unique  combina- 
tion of  decision  alternative  and  state,  the  value  function  may  be 
thought  of  as  defining  a dollar  value  for  each  outcome. 

5.  A utility  U «=  u(v)  defined  for  each  v(s,d) , s e S , d e D 
which  expresses  the  decision  maker's  feelings  toward  risk. 

These  five  model  components,  denoted  |d,S,F,v,u'1  , are  specified  on 
the  basis  of  the  decision  maker's  existing  state  of  experience,  which 
we  explicitly  denote  by  § . One  special  state  of  experience  is  the 
total  knowledge  available  at  the  beginning  of  the  problem,  the  prior 
experience.  When  the  level  of  experience  is  assumed  to  be  the  prior 
experience,  we  shall  use  the  special  symbol  £ . 

According  to  the  principles  of  decision  analysis,  we  can  now  lo- 
cate the  decision  maker's  most  preferred  action  by  selecting  the 
d e D which  results  in  the  greatest  expected  utility;  that  is,  the 
analysis  requires  us  to  solve  for 

d*  - max  1 1 u[v(s,d)]  dF  . (1.2.2) 

d e D s e S 


-10- 


Information  Processing 

Without  doubt,  the.  major  contribution  of  doe  is  Lon  theory  is  the 
recognition  of  uncertainty  and  its  partial  (or  complete  in  the  case 
of  clairvoyance)  resolution  through  information.  By  information  we 
mean  any  data  which  may  alter  the  decision  maker's  predictions. 

If  the  five  facets  of  the  decision  model  are  correctly  specified, 
the  decision  maker's  outcome  uncertainty  is  confined  solely  to  state 
occurrence.  We  make  this  assumption.  Stated  differently,  although 
S , D , F , v , and  u are  all  based  on  the  decision  maker's  prior 
level  of  experience  C , we  hypothesize  that  if  f changes,  the  effect 
on  the  model  is  completely  accounted  for  by  a change  in  F ; that  is, 
by  probability  revision.  The  dependence  of  the  decision  maker's 
probability  distribution  on  his  state  of  experience  will  be  made  ex- 
plicit by  using  the  inferential  notation  r_s  I S ^ to  denote  the  prob- 
ability density  function  of  s . When  we  wish  to  denote  explicitly 
that  the  expected  value  of  a random  vector  _s  is  based  on  the  state 
of  knowledge,  we  will  use  in  place  of 

E(s)  - s dF  (1.2.3) 

sh  S 

the  notation 


"s 


1 _s  fs  I ?> } . 

s k S 


(1.2.4) 


If  the  impact  of  information  is  strictly  limited  to  probability 
revision,  the  basis  for  information  analysis  is  provided  by  Bayes'  rule. 
To  illustrate,  suppose  that  some  information-gathering  method  or  ex- 
periment T]  produces  information  or  signal  y from  some  set  of  pos- 
sible signals  Y . Knowledge  of  y changes  the  decision  maker's 
distribution  on  _s  to  fs|y>?}  , which  is  related  to  the  prior  dis- 
tribution fs|e}  by  Bayes'  equation, 


fs  |y,e] 


y i_s 


{sir/ 


(1.2.5) 


The  quantity  {yj_s,G}  is  the  probability  of  observing  a particular 
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v \ for  any  value  of  the  state  vector  and  is  called  the  likelihood 
function.  The  quantity  'yj?1  is  called  the  preposterior  distribu- 
tion. it  is  the  probability  of  observing  a particular  y s Y before 
the  signal  is  received  and  is  related  to  the  likelihood  function  and 
pri^,r  by 


fy|P]  = 1 {y\s,e.}  fs|P] 

S C S 


(1.2.6) 


A Dynamic  Model 

When  a decision  maker  anticipates  receiving  an  information  signa] 
y , it  is  often  possible  (and  usually  desirable)  to  make  some  components 
of  his  strategy  contingent  upon  that  signal.  In  such  cases  we  shall 
assume  that  his  possible  decision  strategies  are  confined  to  some  fea- 
sible set  D of  decision  functions  defined  over  Y . Each  decision 
function  in  D associates  a feasible  action  from  D to  each  possible 
signal  in  Y , The  optimal  strategy  is  found  by  determining  from  the 
feasible  set  the  function  _(]*(•)  that  maximizes  the  expected  utility. 


d*(')  * max  u(v[_s,d(y)  ])  {s|y,F]  fyl£]  . 

d ( • ) c I)  y'eY  sc  S 


(1.2.7) 


An  Abstract  Representation  of  the  Basic  Decision  Model 
Figure  1.4  is  a useful  abstract  representation  of  the  basic  deci- 
sion model.  Problem  variables  are  divided  into  those  that  are  under 
the  control  of  the  decision  maker-- decision  variables--and  those  not 
under  his  control-- s tate  variables.  We  can  visualize  the  variables  as 
control  knobs,  the  settings  of  which  determine  the  reading  on  a utility 
meter.  The  decision  variables  knobs  are  set  by  the  decision  maker. 

The  state  variable  knobs  are  set  by  a disinterested  Nature.  The  objec- 
tive of  the  decision  maker  is  to  choose  the  best  possible  settings  for 
his  decision  control  knobs,  those  settings  which  will  produce  the  high- 
est expected  reading  on  the  utility  meter.  If  no  additional  information 
will  be  received,  possible  decision  variable  settings  are  the  elements 
of  the  action  set  D . However,  if  a suitable  information  system  exists 
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Decision 

Variables 


FIGURE  1.4  AN  ABSTRACT  REPRESENTATION  OF  THE  BASIC  DECISION  MODEL 


and  the  decision  may  be  conditioned  upon  the  arrival  of  information  sig- 
nals from  this  system,  then  the  possible  decision  variable  settings  are 
functions  of  the  signals.  In  this  case  a set  of  feasible  decision  strate- 
gies D is  determined,  and  the  decision  maker  must  choose  a decision 
control  knob  setting  (a  feasible  function  of  the  signal  y ) from  this 
set. 

!-3  A MATHEMATICAL  DEFINITION  OF  FLEXIBILITY 

We  shall  now  formulate  a mathematical  definition  of  flexibility  us- 
ing the  decision  analysis  framework  developed  in  the  last  section.  The 
Sofa  Sale  example  illustrated  that  flexibility  may  be  interpreted  as  a 
property  of  the  set  of  decision  alternatives  (the  choice  set)  associated 
with  a given  decision  variable.  If  the  deposit  is  made,  Linda  has  two 
alternatives  for  the  purchasing  decision— buy  or  don't  buy- -subsequent 
to  learning  an  important  piece  of  information- -whether  or  not  her  hus- 
band likes  the  sofa.  If  the  deposit  is  not  made,  there  is  only  one  al- 
ternative. Linda  will  not  purchase  the  sofa.  With  flexibility,  the 
decision  choice  set  is  larger. 

We  formalize  this  definition  using  the  decision  model  illustrated 
in  Fig.  1.5.  This  figure  is  identical  to  that  of  Fig.  1.4  except  that 
we  have  illustrated  the  existence  of  an  information  structure  r| 
which  will  yield  an  information  signal  y . The  structure  is  assumed 


FIGURE  1.5  BASIC  DECISION  MODEL  WITH  INFORMATION  STRUCTURE 


to  distribute  the  signal  in  such  a way  that  some  function  of  y , de- 
noted 'j(y)  » is  available  for  the  setting  of  the  decision  variable 
dj  . A common  example  is  the  case  in  which  y represents  data  received 
over  time  and  ?.(y)  is  the  data  received  prior  to  the  setting  of  the 
j cn  decision  variable.  The  set  of  feasible  decision  functions  D will, 
in  general,  consist  of  a set  of  vector  functions  ^ (d^,. . . ,dm)j  for 
which  the  component  d ^ is  a function  only  of  the  fraction  of  total  ex- 
perience (?j(y)jC)  • Imagine  now  that  all  decision  variables  with  the 
exception  of  d^  have  been  set  to  specific  decision  functions  d^,..., 

d?  i >d°. i » • • • >d°  . We  define  to  be  the  set  of  possible  settings 

j-i  j+I  m j 

for  the  decision  variable  d.  , 

J 


D^(S)  - |dj!(dj,...,d°_1,dj,d°+1,...,d°)  eST.sj.  (1.3.1) 


We  shall  define  flexibility  on  the  jth  decision  variable  as  a property 

of  its  decision  set  D.  . 

J 
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DEFINITION  L.3.L:  Imagine  two  decision  models  7T1  ■ D,S,  fs  |£},v,u>- 

f 1 - J 

and  JH'  ■ |^D',S,[s|p}  ,v,Uj-  which  are  identical  except  possibly 
for  the  feasible  action  sets  D and  D'  . Suppose  that  there  is  an 
information  system  r]  and  that  B and  B*'  are  the  respective 
sets  of  feasible  decision  strategies  which  use  the  information  sys- 
tem Tj  . Given  the  state  of  experience  § and  respective  decision 
strategies  for  models  1)1  and  TH ' , we  say  that  decision  variable 

d.  is  less  flexible  than  d!  if  5°  is  a proper  subset  of  D°' 

J J J J 

(denoted  5°  C 6° ' ) . 

J J 


The  decision  variable  d^  will  be  said  to  be  flexible  or  inflexible  de- 
pending upon  whether  or  not  the  set  consists  of  more  than  a single 

(point)  element. 

Notice  that  although  flexibility  is  a property  of  the  decision  set 
for  d^  , in  general,  it  will  depend  upon  the  decision  settings  for  all 
other  decision  variables.  This  corresponds  to  the  common  situation  in 
which  an  action  taken  now  is  a decision  among  later  choice  sets.  Per- 
haps the  action  is  to  acquire  a choice  set.  Perhaps  the  action  is  to 
narrow  down  an  earlier  choice  set.  The  decision  on  whether  or  not  to 
make  the  deposit  in  the  sofa-purchasing  example  can  be  interpreted  in 
either  of  these  ways.  In  such  cases  defining  flexibility  as  the  size 
of  the  decision  choice  set  is  intuitive. 

The  definition  gives  us  some  clues  for  increasing  the  flexibility 
of  a decision  variable.  One  method  is  to  choose  the  setting  of  _d-d^ 
(which  we  mean  to  denote  those  decision  variables  in  _d  with  the  excep- 
tion of  d ) so  as  to  yield  a large  choice  set  for  d.  . This  is  what 

J 

we  did  in  the  sofa-purchasing  example.  Another  is  to  uncover  new  al- 
ternatives so  as  to  increase  the  size  of  the  set  5)  of  feasible  deci- 
sion strategies.  Both  techniques  can  be  used  to  analyze  the  effects  of 
increasing  flexibility;  the  distinction  is  between  an  implicit  and  an 
explicit  evaluation. 


1.4  PLANT  FLEXIBILITY 

In  this  section  we  shall  apply  our  definition  of  relative  flexibil- 
ity to  a classical  problem  in  micro-economic  theory.  The  problem  has  to 
do  with  choosing  production  flexibility  in  the  theory  of  the  firm  and  is 
schematically  illustrated  in  Fig.  1.6.  A number  of  various  designs  for 
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-.I/:,  - 


PROFIT 


CAPACITY  OUTPUT  RFVEALED  QUANTITY 

FIGURE  1.6  PLANT  FLEXIBILITY  DECISION  PROBLEM 

a production  plant  are  possible.  The  particular  design  chosen  will  de- 
termine the  output  capacity  for  the  plant.  At  the  time  plant  output 
capacity  is  chosen,  output  price  and,  therefore,  optimal  output  are  not 
known  with  precision.  However,  a probability  distribution  on  output 
price  is  known.  After  the  plant  has  been  constructed  output  price  is  dis- 
closed, and  plant  output  is  set  so  as  to  maximize  expected  profit.  It 
is  desired  to  determine  the  manner  in  which  varying  the  plant's  output 
flexibility  affects  expected  profit. 

Baumol  [1,  p.  93]  argues  that  "the  existence  of  uncertainty  will 
lead  to  the  (increased)  use  of  equipment  whose  scale  of  operation  is 
flexible."  We  shall  explore  this  conjecture  using  two  simple  models. 

The  first  model  was  devised  by  Marschak  and  Nelson  [10]  and  uses  Stigler's 
[13]  measure  of  plant  flexibility,  a measure  which  is  incompatible  with 
our  own.  For  Stigler,  flexibility  refers  to  the  rate  of  change  of  the 
plant's  marginal  cost  curve.  In  the  second  model,  plant  flexibility  is 
measured  in  a manner  consistent  with  Definition  1.3.1. 

MODEL  1 

Assume  the  various  plant  designs  are  described  by  quadratic  total 
cost  curves, 


2 2 
TC  = ax  + bx  + ax  , 
m 

where  x is  output  quantity.  Average  cost  is  then 


(1.4.1) 
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(1.4.2) 


AC 


2 

x 


. , , m 

ax  + b + a — 
x 


and 


AC(x  ) 
m 


2ax  + 
m 


dAC  (x  ) 
m 

dx 


- 0 


d AC (x  ) 
m 

dx2 


2a 


m 


(1.4.3) 


Thus,  the  quantity  xm  represents  the  output  with  minimum  average  cost, 
and  the  parameter  a measures  the  curvature  of  the  average  cost  curve 
(Fig.  1.7).  The  smaller  a is,  the  flatter  the  curve  at  its  bottom. 
Following  Marschak  and  Nelson  and  Stigler,  we  shall  use  1/a  as  a meas- 
ure of  the  plant's  flexibility  to  produce  outputs  other  than  that  origi- 
nally planned.  According  to  Definition  1.3.1,  however,  all  such  plants 
would  be  termed  equally  flexible  since,  regardless  of  a , any  output 
along  the  positive  real  axis  is  feasible. 

For  price  P , profit  is  given  by 


TT  - Px 


2 

ax 


(1.4.4) 


TC 


FIGURE  1.7  TOTAL  AND  AVERAGE  COST  CURVES 
FOR  PLANT  FLEXIBILITY  MODEL  1 
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Assuming  P > b , the  profit  maximizing  output 


P - b 
2a 


(1.4.5) 


produces  an  optimal  profit 


(P  - b)  2 

* -i L ax 

4a  m 


(1.4.6) 


Now,  suppose  price  is  distributed  with  mean  P and  variance  a . 
Expected  profit  is  then  given  by 


E(n*)  - - ax2  + f-  . 

4a  m 4a 


(1.4.7) 


On  obtaining  this  result,  Marschak  and  Nelson  make  the  observation  that 

2 

as  subjective  uncertainty  increases  (as  measured  by  a ),  expected  profit 
for  the  more  flexible  plant  (small  a ) rises  relative  to  expected  pro- 
fit for  the  less  flexible  plant  (large  a ).  Broadly  interpreted,  this 
supports  Baumol's  claim. 

Yet,  we  are  still  left  with  the  question  of  whether  1/a  is  a good 

measure  of  production  flexibility.  One  disturbing  feature  of  this  meas- 

2 

ure  is  that  in  the  absence  of  uncertainty  (a  » 0)  expected  profit  still 
increases  as  a decreases.  If  price  is  known  with  certainty,  should  not 
the  potential  for  adjusting  to  different  prices  have  zero  value? 

MODEL  2 

This  time  we  assume  the  various  plant  designs  are  described  by  total 
cost  curve  of  the  form 


2 2 - 

(ax  + bx  + ax  , x < x + A 

) m 

TC  -j  . (1.4.8) 

« , x > x + A 

The  maximum  output  which  can  be  produced  from  such  plants  is  x + A , 
and,  therefore,  the  magnitude  of  A determines  the  size  of  the  plant 
output  choice  set.  Following  Definition  1.3.1,  we  may  take  A to  be  a 
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measure  of  the  plant's  output  , flexibility-- the  larger  A is,  the 
greater  the  plant's  flexibility  over  its  output  setting. 

Average  cost  is  given  by 

2 

x 

/ ax  + b + a — , x < x + A 
X 

AC  B | . (1.4.9) 

( -c  , x > x + A 

Once  again,  xm  represents  the  output  with  minimum  average  cost  (Fig. 
1.8).  For  outputs  less  than  x + A , profit  maximizing  output  and  opti- 
mal profit  are  given  by  expressions  identical  to  those  of  Model  1 : 

(1.4.10) 

2 

h*  - -^F— / - ax2  , b < P < 2a  (x  + A)  + b . (1.4.11) 

A c^q,  m 

If  price  exceeds  2a(x  + A)  + b , the  maximum  output  x + A will  be 
chosen  and  profit  will  be  given  by 

T*  *=  (P  - b)(x  + A)  - a(x  + A)2  - ax2  , P > 2a (x  + A)  + b . (1.4.12) 
a in 


TC 


FIGURE  1.8  TOTAL  AND  AVERAGE  COST  CURVES 
FOR  PLANT  FLEXIBILITY  MODEL  2 
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Suppose  price  P is  normally  distributed  with  standard  deviation 
o and  mean  P ■ 2ax  + b . (Actually  we  should  have  P strictly 
greater  than  b to  insure  that  the  optimal  output  is  positive,  We  as- 
sume that  the  probability  of  obtaining  a P < b with  the  normal  dis- 
tribution is  small  enough  to  have  a negligible  effect  on  the  analysis.) 
The  quantity  x represents  the  expected  plant  output,  and  A is  the 
amount  by  which  maximum  plant  capacity  exceeds  the  expected  operating 

output.  Since  minimum  average  cost  is  2ax  + b , if  x exceeds  x 

m m 

the  plant  may  be  expected  to  make  a profit.  Denoting  by  n(x;m,o)  the 

normal  probability  density  with  dummy  variable  x , mean  m , and  stan- 
dard deviation  CT  , the  expected  profit  lost  by  not  choosing  a completely 
flexible  plant  is 


E(Tt  - -£)  - I " rf)  n(P;  2ax  + b,a)  dP 

2a(x+A)+b-  A 


2a(x+A)+b 


r“  [P-2a(x  + A)-  b r . _ 

4^ — n(P;  2ax  + b,r?)  dP 


CT 

4a 


2aA /a 


r (y  . 1^)2  n(y;M)  dy  } 


(1.4.13) 


where  we  have  used  the  change  of  variable  y « (P- 2ax- b)/CT  . As  an  aid  to 
evaluation,  the  integral 


I<^)-  r (y  - ^)2  n(y ; 0 , 1)  dy 

2aA/ o'  ° 


(1.4.14) 


has  been  plotted  in  Fig.  1.9,  Observe  that  the  difference  in  expected 
profit  between  the  completely  flexible  plant  (A  - *)  and  the  plant 
with  minimum  flexibility  (A  - 0)  is  a2/ 8a  . Since  expected  profit 
for  the  completely  flexible  plant  is  [(P-b)2]/4a  - ax2  + CT2/4a 
have  m 


we 


E<t>  -ZSt1-  lO]  + a(x^-  xf)  . 


2aAs 


4a 


£ 


(1.4.15) 
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Finally,  observe  that 


— =f  • [-I*(— )]  >0  , (1.4.16) 

oA  l a 

I'  denoting  the  derivative  of  I . Each  of  the  two  factors  in  (1.4.16) 
increases  with  a . Thus,  the  gain  in  expected  profit  achieved  through 
flexibility  is  larger,  the  greater  the  price  uncertainty  as  measured  by 
ct  . If  there  is  no  uncertainty  (cr  - 0)  , there  is  no  advantage  in  having 
flexibility:  but,  as  a increases,  expected  profit  for  a more  flexible 
plant  rises  relative  to  expected  profit  for  a less  flexible  plant.  This 
model  not  only  supports  Baumol's  claim,  it  also  conforms  well  with  ou:r 
intuitive  notions  of  how  the  value  of  flexibility  should  depend  on  uncer- 
tainty. 

CONCLUSIONS 

Our  definition  seems  to  perform  reasonably  well  when  applied  to  the 
problem  of  determination  of  plant  flexibility.  Notably,  it  leads  to  re- 
sults which  conform  with  our  intuitive  feelings.  However,  unlike 
Stigler's  definition,  ours  says  nothing  about  the  relative  costs  of  vary- 
ing a decision  variable  over  a choice  set.  While  this  may  seem  to  be  a 
serious  limitation,  we  shall  see  that  there  is  an  important  application 
to  problems  in  which  we  ignore  the  costs  of  varying  pre-set  decision 
variables.  This  topic  is  the  subject  of  Chapter  2 of  the  thesis. 
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CHAPTER  2 

THE  VALUE  OF  INFORMATION  GIVEN  FLEXIBILITY 

Everything  else  being  equal,  we  would  all  agree  that  the  more  flex- 
ible of  two  plans  is  the  more  desirabte.  Everything  else,  however,  is 
usually  not  equal.  A more  flexible  strategy  is  typically  more  inconve- 
nient and  often  more  costly  to  follow.  Therefore,  an  economic  measure 
of  the  value  of  flexible  over  inflexible  plans  ought  to  be  quite  useful 
to  the  decision  maker.  In  this  chapter  we  seek  such  an  economic  measure. 

The  example  in  the  latter  part  of  Chapter  1 has  already  demonstrated 
a simple  and  fundamental  rule  concerning  the  value  of  flexibility:  The 

more  you  expect  to  learn  in  the  course  of  a decision  (the  more  uncer- 
tainty will  be  resolved),  the  more  it  pays  to  follow  flexible  decision 
strategies.  The  value  of  flexibility  is  thus  dependent  upon  expected 
information.  However,  we  can  turn  the  argument  around:  The  more  flex- 
ible your  decision  strategy,  the  greater  the  value  of  information-gather- 
ing. In  terms  of  value,  the  concepts  of  information  and  flexibility  are 
inseparable.  If  you  have  no  flexibility  in  your  decisions,  information 
has  no  value.  If  you  expect  to  receive  no  information,  there  is  no  value 
to  having  flexible  decision  rules. 

Therefore,  what  we  really  seek  is  the  value  of  a given  amount  of  in- 
formation and  flexibility.  We  are  in  luck.  With  just  a little  ingenuity 
we  can  turn  the  well-known  expected  value  of  information  calculation  from 
decision  theory  into  a calculation  that  will  tell  us  the  economic  worth 
of  any  combination  of  information  and  flexibility. 

21  PERFECT  INFORMATION  GIVEN  PERFECT  FI£XIBILITY 

The  simplest  case,  which  we  now  present,  will  demonstrate  the  re- 
quired logic  for  economically  evaluating  information  with  flexibility. 

Suppose  that  the  decision  model  is  the  basic  decision  model  of 
Fig.  1.4  and  that  the  time  order  of  the  decision  process  is  as  illus- 
trated in  Fig.  2.1.  The  decision  maker  must  choose  the  action  vector 
— so  as  to  obtain  a value  lottery  with  the  highest  utility.  The  de- 
sired value  of  d , denoted  d*  , will  be  the  solution  to 
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SETS  d 
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NATURE 

SETS 


OUTCOME 


FIGURE  2.1 


DECISION  PROCESS  WHEN 
NEITHER  INFORMATION  NOR 
FLEXIBILITY  IS  AVAILABLE 


d*  = max  * -Ti|d,F>  . 
dcD 


(2.1.1) 


Equation  (2.1.1)  is  merely  a restatement  of  Eq.  (1.2.2)  using  the  infe- 
rential notation  described  in  Section  1.2.  Use  of  this  decision  strat- 
egy will  result  in  a maximal  expected  utility  which  we  will  denote  by 
■u|R>  : 

<u  |£>  = <u  |d*,C>  . (2.1.2) 

Now,  suppose  that  a clairvoyant  offers  us  perfect  information  on  the 
outcome  of  state  variable  s , but  that  we  are  restricted  to  using  such 
information  only  for  the  setting  of  decision  variable  d^  . In  other 
words,  at  the  time  the  i^1  state  variable  is  revealed,  flexibility 
exists  only  on  the  j^1  decision  variable.  Schematically,  the  time  order 
of  the  decision  process  is  now  as  illustrated  in  Fig.  2.2. 

The  maximum  amount  of  money  the  decision  maker  should  be  willing 
to  pay  to  convert  the  decision  problem  in  Fig.  2.1  to  the  decision  prob- 
lem in  Fig.  2.2  we  define  to  be  the  expcc  ted  value  of  per  fee  t information 
on  state  variable  s^  g iven  perfect  flexibility  on  decision  variable  _dj  • 
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r\ 
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FIGURE  2.2  DECISION  PROCESS  WITH  PERFECT  INFORMATION  ON  s.  GIVEN  PERFECT 
FLEXIBILITY  ON  d. 
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The  information  is  said  to  bo  perfect  because  it  Lotally  eliminates  uncer- 
tainty on  tine  i^h  state  variable.  Tine  flexibility  is  said  to  be  perfect 
because  receipt  of  the  information  does  not  in  any  way  limit  the  basic 
alternatives  available  for  the  j*-h  decision.  The  expected  value  of  per- 
fect information  on  s^  given  perfect  flexibility  on  ch  , denoted 
<'^CspFdjK>  * may  be  obtained  from  an  expected  value  of  perfect  infor- 
mation calculation  in  which  only  the  flexible  decision  variable  is  ad- 
justed to  compensate  for  the  given  information. 


CALCULATION  PROCEDURE 


a 

1. 


Let  information  on  s.  e 

l ° 

price  p . Calculation  of 
Find  the  optimal  decision 


iven  flexibility  on  d.  be  purchased  at 
*"^Cs  • Fd  ■ proceeds  as  follows: 

strategy  for  decision  variable  d.  . 


d*(s  . ,d-d  .) 
J i-  J 


-1 

max 

d i s-  s . 

J — l 


n |_s  ,_d , p , P • fs  1 s L , ?, } . 


(2.1.3) 


Solve  for  the  optimal  decision  settings  for  the  remaining  decision 
variables . 


(d-d  J*  - max  <u  |s  d*  d-d  ,p,P  - rs.  f}  . (2.1.  A) 

d-d.  s.  L J J 1 

~ J L 

The  utility  of  tlie  lottery  with  information  on  s^  , flexibility 
on  d j is  then 

<u  |CsiFdj,p,e>  = 'o |d * >(d- d j ) *.p , p"'  . (2.1.5) 


A.  The  value  of  p which  satisfies 

•Oi!Cs.Fdj,p,P  • = -m  |p  '•  (2.1.6) 

is  defined  as  the  expected  value  of  perfect  information  on  s. 
given  perfect  flexibility  on  d.  . 
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PERFECT  INFORMATION  ON  A SET  OF  STATE  VARIABLES  GIVEN  PERFECT  FLEXI- 
BILITY ON  A SET  OF  DECISION  VARIABLES 

Perfect  information  on  a subset  of  state  variables,  say  all  s^  , 
i e I C (l,...,n|  , given  flexibility  on  some  subset  of  decision  vari- 

f > 

ables  , d . > , J ; (l,...,m}  , would  be  defined  as  the  information 

structure  in  which  the  value  of  each  s^  , i e I was  revealed  to  the 
decision  maker  prior  to  his  setting  of  the  decision  variables  d^  , 
j e J . The  value  of  such  information  given  flexibility  would  be  de- 
fined and  calculated  in  an  obvious  way  following  steps  similar  to  1-4 
above.  If  the  decision  maker  is  allowed  to  adjust  all  decision  variables 
in  response  to  information,  we  say  that  he  has  information  given  complete 
flexibility.  This  is  the  usual  assumption  for  the  analysis  of  informa- 
tion in  decision  theory  literature. 

CASE  OF  LINEAR  UTILITY 

A special  case  in  which  the  value  of  information  given  flexibility 

is  especially  easy  to  calculate  occurs  if  the  utility  function  is  linear 

in  value.  In  this  situation,  if  Cs  Fd  denotes  the  information  struc- 

1 «J 


ture  with  clairvoyance  on  state  variables  s^  , i e I and  flexibility 

on  decision  variables  d.  , i c ^ 

J 

flexibility  structure  is  given  by 


on  decision  variables  d^  , j c J , then  the  value  of  this  information- 


%FdJp>-^!CsiFdj>E>-  <*!«> 

1 vJ 


(2.1.7) 


Equation  (2.1.7)  is  easily  proven.  Taking  the  example  of  Fig.  2.2  and 
assuming  u ■ a + bv  , b ^ 0 , 

<u  |Cs  ^Fdj  ,p  ,£>  - <u|C>  ■ a + b(-:'V  |Cs^Fd ^ ,£>  - p)  - a - b<v|£> 

■ b(-rv  |Cs^Fd j ,6>  - <v|f>-  p)  . (2.1.8) 

By  definition,  when  p ■ <^Cs-Fd-!^>  » the  left-hand  side  of  (2.1.8)  is 


zero,  implying 


^Cs  Fd  le>"  -^|Cs.Fd  F>-  <v|e> 

i j J 


(2.1.9) 


-26- 


RELATION  OF  INFORMATION  GIVEN  FLEXIBILITY  TO  DEFINITION  1.3.1 

Information  given  flexibility  increases  flexibility,  as  defined  in 
Chapter  1,  by  increasing  the  size  of  the  decision  set  D . As  a result, 
the  decision  set  for  dj  , , is  larger  both  for  the  prior  state  of 

experience  £ and  for  the  posterior  state  of  experience  (s^,£)  . 

When  the  state  of  experience  is  £ and  the  model  is  as  illustrated 
in  Fig.  2.1,  the  feasible  decision  set  consists  of  all  m- dimensional 
vectors  lying  in  some  subset  D of  the  Euclidian  space  Em  . Using  the 
notation  of  Chapter  1, 


Dj(£)  ‘ {djl<dl-'"-d°.l'dj"d]+l dm>  SD'S}-  (2-1-10) 

If  the  model  is  as  illustrated  in  Fig.  2.2,  the  j th  decision  variable  is 
more  flexible  than  (or  at  least  as  flexible  as)  the  model  of  Fig.  2.1 
since  d^  may  now  be  a function  of  s.  : 

Dj,<e> " {dj<')i<di d)-l,dj<s1>'dj+I -:>  ■ » 

for  all  s^ej-  . (2.1.11) 


Because  the  set  of  functions  from  the  space  of  s.  to  e'  includes  the 

| 1 

real  numbers  as  a trivial  case,  D°(£)  C D°  (£)  . 

Once  the  information  s^  becomes  known,  in  the  case  of  Fig.  2.1 
the  feasible  decision  set  for  dj  consists  of  a single  element, 

D°(s.,£)  «{dj}.  (2.1.12) 

However,  in  the  case  of  Fig.  2.2  it  consists  of  all  real  numbers  that 
put  _d  in  D : 


Dj  (s.,£) 


■'{dj 


(dl dj-l,dj,dj+l. d«») 


D,s.,£|  . 


(2.1.13) 


Hence , 

D°(s.,£)  C D°'(s.,£)  . 
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2.2  APPLICATIONS  OF  THE  EVPIGPF 


Just  as  the  expected  value  of  perfect  information  (EVPI)  is  a useful 
yardstick  for  evaluating  information- gathering  systems,  the  expected 
value  of  perfect  information  given  perfect  flexibility  (EVPIGPF)  is  use- 
ful for  evaluating  information  distribution  systems. 

Suppose  a decision  maker  is  considering  the  construction  or  pur- 
chase of  some  information- gathering  and  distribution  system.  The  cost 
of  the  proposed  system  will  consist,  first  of  all,  of  information  col- 
lection, tabulation,  and  storage  costs.  In  addition,  however,  there  will 
be  costs  involved  in  having  a particular  piece  of  that  information  avail- 
able at  a specific  time  or  available  to  a specific  individual  in  the 
decision  process.  Different  information  distribution  systems  will  incur 
different  costs,  just  as  systems  which  gather  different  information  have 
differing  costs.  By  placing  a value  on  completely  resolving  specific 
uncertainties  for  specific  decisions,  the  EVPIGPF  allows  the  decision 
maker  to  consider  seriously  only  those  information-gathering  and  distribu- 
tion schemes  whose  costs  do  not  exceed  this  value.  It  may  thus  be  used 
to  evaluate  the  various  information-distribution  structures  that  might  be 
used  in  a given  resource  commitment  problem. 

We  can  state  this  use  somewhat  differently  in  terms  of  evaluating 
flexibility  rather  than  information.  Although  decision  analysis  method- 
ology implicitly  assumes  decisions  to  be  irrevocable,  in  many  cases  deci- 
sion variables  can  be  reset  at  some  cost.  As  stated  by  Howard  [8,  p. 

507], 

An  executive  viewing  the  results  of  a decision  analysis 
may  think:  "It  couldn't  come  out  that  bad  because  I 
would  have  done  something  about  it."  The  analysis  does 
not  generally  take  into  account  the  ability  to  compen- 
sate for  ultimate  state  variable  changes  through  adjust- 
ments in  decision  variables. 

Flexibility  provides  a means,  and  the  EVPIGPF  provides  a measure  of  the 
value  of  taking  into  account  the  possibility  of  compensating  for  ultimate 
state  variable  changes. 

EXAMPLE:  THE  ENTREPRENEUR'S  PRICE  QUANTITY  DECISION  w 

An  entrepreneur  must  decide  upon  a price  and  quantity  for  his 
product.  He  is  uncertain  about  the  total  cost  c per  item  but  feels 
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that  it  may  be  represented  by  the  uniform  distribution  of  Fig.  2.3.  He 
knows  that  the  demand  for  his  product  will  be  a decreasing  function  of 
his  price,  but  for  any  given  price  he  is  uncertain  as  to  the  exact 
quantity  of  his  product  demanded.  For  this  reason  he  hypothesizes  the 
following  functional  form  for  demand  x ; 


x 


b - e , 


(2.2.1) 


where 

x * demand  (in  thousands  of  units), 
p ■ price  (in  thousands  of  dollars), 
a ,b  = parameters  of  the  demand  curve,  and 

6 - 3.  random  variable  independent  of  c and  uniformly 
distributed  from  zero  to  one. 

Figure  2.4  shows  the  probability  density  for  e and  the  demand  curve 
x(p)  . Further  let 


q = quantity  produced  (in  thousands  of  units)  and 
v * net  profit  (in  millions  of  dollars). 

We  wish  to  determine  our  entrepreneur's  expected  net  profit  and  the 
value  to  him  of  using  numerous  perfect  information- perfect  flexibility 
structures.  In  other  words,  we  would  like  to  know  how  much  it  is  worth 


1 


l 

\ 


c = TOTAL  COST  PER  ITEM 
(in  thousands  of  dollars) 


0 

c 


1 


FIGURE  2.3  PROBABILITY  DENSITY  FUNCTION 
FOR  PRODUCTION  COST  IN  THE 
ENTREPRENEUR'S  DECISION 
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FIGURE  24  THE  DEMAND  C'JRVE  AND  THE  PROBABILITY  DENSITY  FUNCTION  FOR  THE 
DEMAND  PARAMETER  e IN  THE  ENTREPRENEUR'S  DECISION 

to  the  entrepreneur  to  obtain  perfect  information  on  various  state  vari- 
ables if  be  uses  that  information  when  setting  various  decision  vari- 
ables. In  all  there  are  3x3  ■ 9 possible  information- flexibility 
combinations  (excluding  the  null  structure). 

The  computations  are  performed  in  Appendix  B and  summarized  in 
Table  2.1  f r particular  parameter  values  of  a = 2.25  and  b <=  .5  . 
Observe  first  of  all  that  the  expected  value  of  the  entrepreneurial 
venture  is  half  a million  dollars  and  is  obtained  through  an  optimal 
decision  strategy  of  setting  price  at  $1,000  and  quantity  at  1,250 
units.  The  entries  in  the  table--  V(.p  , p*  , and  q*  — respectively 
denote  the  value  of  the  informat  ion- flexibility  structure  and  the  op- 
timal decision  strategy  appropriate  to  the  structure  corresponding  to 
a given  location  in  the  table.  For  example,  the  value  to  the  decision 
maker  of  obtaining  clairvoyance  on  the  demand  parameter  e for  the 
purpose  of  setting  his  production  quantity  q is  $123,680  . It  may 
be  possible  for  our  entrepreneur  to  pick  a price,  estimate  the  demand 
parameter  e through  a market  survey  or  trial  marketing  venture,  and 
then  set  his  quantity.  According  to  the  table,  if  he  does  this  he 
should  set  price  at  1.061  thousand  dollars,  conduct  his  estimation  of 
e , and  then  set  quantity  at  1.621  - e thousands  of  units.  Further, 
this  action  should  only  be  considered  if  a good  estimate  of  e can  be 
obtained  for  under  $128,000. 


a a 

b ♦ 1 b 


-30- 


TABLE  2.1 

Value  of  and  Decision  Strategy  for  Various  Information- 
Flexibility  Structures  in  the  Entrepreneur's  Decision 


Knowledge  of  EVPIGPF's  can  generate  insight  that  is  not  provided  by 
EVPI's  alone.  For  example,  observe  that  the  value  of  clairvoyance  on 
costs  given  flexibility  on  price  is  zero,  but  the  value  of  clairvoyance 
on  costs  given  flexibility  on  price  and  quantity  is  $139,416.  Informa- 
tion about  costs  is  useful  for  setting  price  but  only  if  that  informa- 
tion is  used  for  setting  quantity  as  well.  Once  quantity  has  been 
fixed,  price  must  be  set  so  as  to  clear  the  inventory  and  costs  are  no 
longer  a consideration.  Insight  may  also  be  provided  on  decision  tim- 
ing. If  information  on  the  demand  parameter  e is  purchased,  vir- 
tually all  the  usefulness  of  the  information,  $151,639  worth,  can  be 
obtained  using  it  only  to  set  price  Delaying  production  until  after 
this  information  becomes  available  will  only  be  worth  an  additional 
$285.' 

2 • 3 INFOP»..vriON  GIVEN  PARTIAL  FLEXIBILITY 

We  referred  to  the  above  calculations  as  situations  of  "perfect 
information  with  perfect  flexibility."  This  is  because  a clairvoyant 
was  imagined  to  have  provided  us  with  perfect  information  on  the  out- 
come of  state  variables,  and  we  presumed  that  decision  variables  could 
be  set  anywhere  within  the  feasible  action  set.  In  many  cases  the  ap- 
proximation of  the  clairvoyant  is  not  satisfactory  for  the  evaluation 
of  an  information-gathering  scheme;  we  must  consider  the  purchasing 
of  an  information  signal  or  experiment  rather  than  perfect  informa- 
tion. This  presents  little  conceptual  difficulty,  however,  as  Bayes' 
equation  allows  us  to  calculate  the  effect  of  experimentation  on  our 
prior  distribution.  Hence,  we  can  evaluate  the  economic  impact  on  our 
profit  lottery. 

Similarly,  the  delaying  of  a decision  so  that  more  information  may 
be  gathered  may  well  restrict  the  range  over  which  that  decision  vari- 
able may  be  varied.  If  our  entrepreneur  were  living  in  our  present  day 
of  shortages  and  potential  government  legislated  price  freezes,  he 
might  find  that  a short  delay  could  seriously  restrict  his  range  of 
feasib.e  output  quantities  and  prices. 

Tie  model  appropriate  for  representing  diminished  flexibility  de- 
pends on  the  nature  of  the  problem  being  investigated.  In  some  cases, 


flexibility  for  a particular  decision  variable  is  itself  a decision 
under  the  control  of  the  decision  maker.  Contracts  may  be  negotiated 
which  spell  out  in  legal  terms  the  latitude  available  for  some  action. 

A specific  example  would  be  the  purchase  of  an  "option  to  buy"  so  many 
units  of  some  commodity.  In  other  situations,  the  restriction  of  flex- 
ibility is  the  work  of  Nature  and  under  little  control  of  the  decision 
maker . 


A MODEL  FOR  PARTIAL  FLEXIBILITY 

A fairly  general  model  for  evaluating  information  and  flexibility 
is  the  following.  Imagine  that  for  a price  p , instead  of  having  to 
set  _d  prior  to  learning  _s  , our  decision  maker  takes  some  action  f 
which  is  designed  to  preserve  a measure  of  flexibility  on  the  j n deci- 
sion variable  d^  . The  flexibility  is  preserved  until  after  an  infor- 
mation system  r can  be  made  to  produce  a signal  y from  some  set  of 
possible  signals  Y . 

The  precise  flexibility  maintained  for  d.  will,  in  general,  de- 

f J 

pend  upon  both  _d- d ^ and  _s  . Let  D,(d-d^,_s)  denote  the  choice  set 
for  dj  faced  by  the  decision  maker  if  the  flexibility  producing  ac- 
tion is  taken.  The  primary  decision  problem  and  the  decision  problem 
with  the  information  system  and  partial  flexibility  are  illustrated  in 
Fig.  2.5. 


PRIMARY  DECISION  PROBLEM 


DECISION 

MAKER  SETS 
d 


O 


NATURE 

SETS 


OUTCOME 


DECISION  PROBLEM  IF  ACTION  I IS  PURCHASED 


DECISION 


MAKER  SETS 
d.  WITHIN  d! 


o 


NATURE 

SETS 


-►  OUTCOME 


FIGURE  2.5  PRIMARY  DECISION  PROBLEM  AND  DECISION  PROBLEM  WITH  INFORMATION 
SYSTEM  AND  PARTIAL  FLEXIBILITY  ON  d( 
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Value  of  Information  Given  Partial  Flexibility 

The  value  of  the  information  system  r|  with  the  partial  flexibil- 
ity on  is  defined  as  the  maximum  price  p our  decision  maker 

should  be  willing  to  spend  to  achieve  the  problem  conversion  shown  in 
Fig.  2.5. 

Calculation  of  this  value  for  the  general  model  described  above 
will,  in  most  cases,  be  quite  difficult,  so  a number  of  additional  as- 
sumptions are  likely  to  be  made.  We  shall  illustrate  the  calculation 
under  two  additional  assumptions: 

1.  The  choice  set  D j"  is  uncertain  but  independent  of  _d-d^  . 

2.  Choice  set  uncertainty  is  limited  so  that  D f must  be  one  of 

f J 

the  K.  sets  D (k)  , k «*  1 , . . . ,K  . The  probability  that  set 
f ** 

D (k)  results  given  that  the  information  signal  is  y is 

Pk(y)  • 

For  notat ional  convenience  we  shall  also  assume  that  any  information 

on  s that  our  decision  maker  is  able  to  deduce  from  the  outcome 

D j (k)  has  been  incorporated  into  the  signal  y . (Following  the  usual 
assumption  of  information  analysis  we  assume  that  the  data  y is  inde- 
pendent of  the  actions  _d  .) 

To  begin  the  calculation,  assume  that  the  choice  set  is  Dj(k) 
and  the  signal  is  y . The  optimal  feasible  action  for  d.  will  be 
the  solution  to 


<U|d-d  ,y,D  (k),p,f>  = max  f <u  I d ,s  , p , P>  f s |y  ,f.  ] , (2.3.1) 

J J d.sDr(k)  s- 

J J - 

where  the  posterior  distribution  fs'y.P]  is  given  by  Bayes’  equation 
( 1'  Now,  Pi^(y)  is  the  probability  that  the  choice  set  will  be 

D j (k)  Biven  ^at  the  signal  is  y , and  fy|fi}  is  the  preposterior 
probability  that  the  data  y will  actually  be  obtained.  Therefore, 
the  expected  utility  of  the  optimal  decision  strategy,  given  the  in- 
formation gathering  technique  r\  and  partial  flexibility  on  dj  pur- 
chased at  a price  p , is 
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(2.3.2) 


K 

P V"  f 

<u|r],f,p,e>  ■ nax  . ' <u 'd-d  ,y ,D . (k) , p,P>  p (y)  fy|p}  . 

-_dj  ^ w J J 

Finally,  the  value  of  p that  satisfies 

<u ln,f ,p,e>  “ |P>  (2.3.3) 

is  the  value  of  the  information  system  r\  with  the  partial  flexibility 
on  d.  produced  by  action  f . 


CHAPTER  3 

DECISION  MODELS  WITH  QUADRATIC  VALUE  FUNCTIONS 

In  this  chapter  we  shall  exploit  the  special  characteristics  of  a 
quadratic  function  in  an  'ffort  to  gain  a better  understanding  of  the 
value  of  obtaining  information  given  flexibility.  The  analysis  will  be 
built  around  the  basic  decision  model  of  Fig.  1.4  for  the  special  case 
in  which  (1)  the  decision  maker's  value  function  is  quadratic  in  both 
state  and  decision  variables,  and  (2)  the  decision  maker's  utility 
function  is  linear  in  wealth. 

Almost  all  of  the  essential  features  of  the  quadratic  problem  are 
present  in  the  case  in  which  there  are  two  state  variables  and  two  deci- 
sion variables.  Consequently,  we  begin  the  analysis  with  the  following 
example. 

3 . 1 EXAMPLE:  A FOUR -VARIABLE  PRODUCTION  PROBLEM 

A firm  produces  two  outputs  using  fixed  proportions  ol  two  inputs. 
Each  unit  of  output  one  requires  a l units  of  input  one,  a2  units  of 
input  two.  Similarly,  each  unit  of  output  two  requires  b^  units  of 
input  one  and  units  of  input  two.  The  marginal  revenue  produced 

by  selling  the  two  outputs  smoothly  diminishes  as  the  quantity  of 
either  output  increases  ("diminishing  marginal  returns").  Specifically, 
we  assume  that  the  revenue  is  a quadratic  function  of  the  respective 
output  quantities  and  x2  : 

2 2 

R = "X1  " x2  + 2qxix2  + wixi  + W2X2  + h - (3.1.1) 

Output  units  have  been  chosen  so  as  to  make  the  coefficients  of  the 
quadratic  terms  -1  . The  quantity  q measures  the  complementarity 
(-q  the  substitutability)  between  the  two  output  products. 

Let  the  respective  per  unit  prices  of  the  inputs  be 

P1  " rai  + SL  aild  P2  " m2  + s2  ’ (3.1.2) 

where  and  n»2  are  mean  prices  and  Sj^  and  s2  are  random 
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variables  with  zero  expectations.  The  net  profit  to  the  firm  will  be 
(see  Fig.  3.1) 

2 2 

tt  ■ -Xj  - x2  + 2qx^x2  + w^x^  + ^2*2  + 11 

- >h  (Oj^  + a2p2)  - x„(blPl  + b2p2)  . (3.1.3) 


Our  objective  is  to  determine  the  quantities  x^  and  x2  that 
will  maximize  expected  profit.  Let  us  measure  these  quantities  from 
the  values  x^  and  x2  that  would  be  optimal  if  the  input  prices  are 
at  their  mean  values.  Since  ■ ?^n/dx2  = -2  , ^tt/3x^9x2  ■ 2q  , 

the  concavity  condition 


o 


*1*2 


*2n 


TT 


> 0 


(3.1.4) 


PRICE 
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1 


PRICE 

INPUT 

2 


w 


FIGURE  3.1  A FOUR-VARIABLE  PRODUCTION  PROBLEM 
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I 


is  satisfied  for  |q | 1 . This  assumption  insures  that  for  every  com- 
bination of  p^  and  p^  , *t  has  a unique  maximum.  Putting  prices  at 
their  mean  values,  differentiating,  and  setting  the  results  to  zero,  we 
obtain 

~ W1  ~ aiml~a2m2  + q(w2  “ blml  " b2m2) 


<v 

X„ 


2(1  - q ) 

'1  “ “imi  “ a2m2^ 


q (w!  “ ^i"1,  - a0mo)  + w2  - b^  - b2m2 


2(1  - q ) 


Defining  d^  and  d2  as  deviations  from  these  values, 


(3.1.5) 


cL  ® dL  + xL  and  x2  d + x , 


(3.1.6) 


profit,  in  terms  of  the  deviations  and  d2  of  the  output  levels 

from  their  deterministic  optimums  and  in  terms  of  the  deviations  s. 


and 


s2  of  the  input  prices  from  their  mean  values,  is  given  by 


n(?1,s2;d1,d2)  - -dj  - d2  4 2qd]_d2  - d1(a1s1+  a^)  - d^s^  b2s2) 
- <1(a1s  L + ozs2)  - x2(blSl  + b,s2)  + n , (3.1.7) 


where 


■ ( x ^ , x2 , m^  , m2) 


(3.1.8) 


is  the  maximum  profit  if  input  prices  are  set  at  their  mean  levels. 
Since  the  last  three  terms  in  (3.1.7)  do  not  depend  on  the  decision 
variables,  for  the  purposes  of  optimization  we  may  redefine  the  profit 
origin  and  take  as  our  value  function 

v(P1,s2;d1,d2)  = -d*  - d2  + 2qdxd2  - d^a^  + a^) 


- d2(b1s1  + b2s2)  . (3.1.9) 
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Notice  that  if  q wore  zero  the  value  function  in  (3.1.9)  would 
be  additive,  that  is,  oi  Lho  form 


v(s;d15d2)  = v^jd^  + v2(s;d2)  . 


(3.1.10) 


Thus,  q is  a measure  of  the  interaction  between  the  decision  vari- 
ables. The  quantities  within  the  parentheses  in  (3.1.9)  are  the  devia- 
tions from  mean  values  of  the.  per  unit  output  costs  for  outputs  one  and 
two.  The  parameters  a^  , a2  , b^  , and  b2  measure  the  interaction 
in  the  value  function  between  the  various  state  and  decision  variables. 

We  shall  assume  that  s^  and  s0  have  the  bivariate  normal 
distribution 


fs  s^  If  } 


!-  A"-  * 


exp  /-  CP) 

L in.  i -v  1 


2(1-  “) 


S1S2 

2otT"T  + 

1 2 


(^f]|  • 

9 J 


(3.1.11) 


The  quantity  o is  the  correlation  coefficient  and  indicates  the  ex- 
tent to  which  the  variables  tend,  on  the  average,  to  move  together  or 
in  opposite  directions.  It  is  easy  to  show  that 


^ (s  Is 9)  = ° Y'2  ’ (3.1.12) 

1 a2 

K(s2!s1)  = 0 ~ S]L  . (3.1.13) 


We  shall  now  proceed  to  calculate  the  optimal  decision  rules  and 
relative  values  under  each  of  the  possible  perfect  information  with 
perfect  flexibility  structures.  In  each  case  the  optimal  decision 
rules  were  obtained  by  differentiation. 

CASE  1:  NO  INFORMATION  (NO  FLEXIBILITY) 


<v|e>  = max  - d2  + 2qd1d2  - (1]_(alsi  + a^)  - d^b^  + b^)  ] 

dld2 


- 0 > 


(3.1.14) 


d*  = d*  = 0 . 


(3.1.15) 
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Because  <v|£>  *=  0 , the  value  of  any  information  given  flexibility 
structure,  <v  |CF,P->  - <v  lr>  , will  simply  equal  the  expected  payoff 
<v!CF,e->  . 

CASE  2:  COMPLETE  INFORMATION  - COMPLETE  FLEXIBILITY 


<v  jCs^s^Fd^d^ ,£>  ■ E[  max  v"j 


dld2 


2,  2 


(a^+2qa1b1+bJ)aJ  + 2[a1a2+q(a1b2+a2b1)+b1b2]0o1a2+(a2+2qa2b2+b2) a\ 


d2 


4(1  - q ) 


alSl  + a2S2  + q(blSl  + b2S2) 
2d  - q2) 


q ( a 1 s i + a2s2)  -i-  blSl  + b2s? 

2(1  - q2} 


(3.1.16) 


(3.1.17) 


Defining  c^  *=  a^s^  + a2s2  , c2  » b^s^  + b2s2  to  be  the  deviations  of 
the  per  unit  output  costs  from  their  mean  values, 


dl 


C1  + qc2 


2(1 


q2) 


and 


d2 


qCl  ^ C2 
2(1  - q2) 


(3.1.18) 


Observe  that  if  the  outputs  are  complements  (q  > 0)  , [substitutes 
(q  < 0) ] , the  optimal  output  quantity  falls  as  its  cost  rises  and 
falls  [rises]  when  the  cost  of  the  other  output  rises.  Expressing  the 
optimal  decision  rule  as 


(al+qb1)s1+(a2+qb2)s2  (qa,+b, )s,+(qa,+b,)s, 

df  ^ and  d*  -= — -- — — = — t — t 

2(l-q  ) 2(l-q2) 


(3.1.19) 

we  see  that  the  optimal  quantities  will  normally  fall  when  an  input 
price  is  increased.  In  order  for  the  reverse  to  be  the  case,  we  must 
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have  either  little  coupling  between  the  output  processes  ( a 
close  to  zero),  or  the  products  must  be  strong  substitutes. 
We  may  also  write  (3.1.16)  as 


<v  jCs^Fd.^  ,£  > 


j + 2qra  a 
C1 C1  2 

4(1  - q2) 


+ a 


or  b^ 


(3.1.20) 


where 


E(cJ)  , 

E(c2)  , and 


r - E(c.c  )/ct  a 
12 


Observe  that  the  advantage  of  making  decisions  with  full  knowledge  of 
costs  is  larger,  the  larger  the  product  (qr)  of  the  coefficients  of 
interaction  and  correlation.  If  correlation  between  output  costs  is 
positive,  the  advantage  is  larger  if  the  output  products  are  comple- 
ments (q  > 0)  . If  correlation  is  negative,  the  advantage  is  larger 
if  the  outputs  are  substitutes  (q  < 0)  . 


CASE  3:  PERFECT  INFORMATION  ON  s1  - COMPLETE  FLEXIBILITY 


<v  |CSjFd^d2>£>  - E [ max  E (vjs^) 

srdid2  s2 

2 2 2 2 2 2 2 

(a^qa^bj+b  ) H^ta^+qta^+a^^+a^] 0a1a2+(a2+2qa2b2+b2^ 0 CT2 


2 2 
ct  + 2q  rj  o + ar 

C1 C1  2 2 

4(1  - q2) 


4(1  - q ) 


2 2 

(1  - o)n7  7 ? 

T (a2  + 2qa2b2  + V ’ 


(3.1.21) 


4(1  - q ) 


df 


o2  o2 

al+a2^  +q(bl+b2P— } 

2(1  - q2) 


On 


and  d* 


q(ai+a2p-)+b1+b2p- 


2d  - q ) 


(3.1.22) 
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The  decision  functions  (3.1.17)  are  identical  to  (3.1.22)  except 
that  in  the  latter  case  the  random  variable  s2  is  replaced  by  the 
estimate  ^(s^Sj.)  - oCc^/o^s^  . This  is  an  illustration  of  the  well- 
known  certainty  equivalence  principle:  When  the  value  function  is 

quadratic,  in  the  face  of  uncertainty  the  decision  maker  behaves  as  if 
he  were  certain  that  random  variables  take  on  their  expected  values. 

Subtracting  (3.1.21)  from  (3.1.16)  we  obtain  the  value  of  obtain- 
ing clairvoyance  on  S|  and  s2  over  the  value  of  clairvoyance  on  s^ 
a lone . 


<v|Cs1s2Fd1d2,e>  - rvjCSjFd^ 


,e> 


n 2\  2 

(L“P  >n2  2 ? 

2~  (a.+2qa  b +b  ) . 

4<l-q  ) 222 


(3.1.23) 

Clairvoyance  on  Sj^  and  s2  over  clairvoyance  on  sl  is  more  valuable 
the  smaller  the  correlation  (positive  or  negative)  and  the  larger  the 
variance  of  s2  . As  a function  of  the  interaction  q , the  value  ap- 
pears as  illustrated  in  Fig.  3.2. 


FIGURE  3.2  THE  ADDITIONAL  VALUE  OF  CLAIRVOYANCE  ON  s AND 
s2  OVER  THE  VALUE  OF  CLAIRVOYANCE  ON  s,  ALONE 
AS  A FUNCTION  OF  q IN  THE  FOUR-VARIABLE  PRODUCTION 
PROBLEM 
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CASE  4:  PERFECT  INFORMATION  ON  s2  - COMPLETE  FLEXIBILITY 

By  symmetry, 


<v  |Cs2Fd1d2,e> 


c2  +2qr  a 
C1 


2 


4(l-q2) 


2 2 

(1-p  )o[ 

4(l-q2) 


(a^+2qa1b1+bj) 


(3.1.24) 


It  is  interesting  to  compare  the  value  of  clairvoyance  on  s^  with  the 
value  of  clairvoyance  on  s2  . Subtracting  (3.1.24)  from  (3.1.21), 


<v  |Cs^Fd^d2 ,?>  - <v |Cs2Fd1d2,£> 

2 

. [(a2+2qa1b1+b2)a2.(a2+2qa2b2+b2)a2]  . (3.1.25) 

4(1- q ) 

Which  information,  s.  or  s_  , is  more  valuable  depends  on  the  vari- 
2 2 1 L 

ances  and  ^ and  also  on  the  relative  proportions  in  which  the 

inputs  are  used.  If  the  input  prices  are  strongly  correlated,  which 
of  the  two  prices  is  ascertained  is  not  important. 

It  is  well  known  that  the  value  of  simultaneous  information  on 
several  variables  may  br.  greater  than  or  less  than  the  sum  of  their 
individual  values  of  information.  Subtracting  (3.1.24)  and  (3.1.21) 
from  (3.1.16), 

<v  |Cs1s2Fd1d2,e>  - <v  |Cs1Fd1d2,e>  - <v  jCs^d^ ,£> 

2 2 2 

(a^+2qa^b^+b^)  p + 2[a^a2+q(a^b2+a2b^)+b^b2]  pa^c^ 

■ m ■■  ■ ■ - — ■■■—  - ■ — 

4(1  - q2) 


+ 


2 2 2 2 
(a2+2qa2b2+b2) p 

4(1  - q2) 


(3.1.26) 


As  a function  of  the  correlation  coefficir  .t  p , this  appears  as  in 
Fig.  3.3.  Observe  that  if  the  random  variables  are  independent  (p  ■ 0), 
then  the  value  of  clairvoyance  on  s^  , s2  equals  the  sum  of  the  indi- 
vidual values  of  clairvoyance  on  s^  and  on  s2  . The  sign  of 
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FIGURE  3.3  THE  JOINT  VALUE  OF  CLAIRVOYANCE  MINUS  THE 

INDIVIDUAL  VALUES  OF  CLAIRVOYANCE  IN  THE  FOUR- 
VARIABLE  PRODUCTION  PROBLEM 


<v  |Cs1s2Fd1d2,e>  - <v|Cs1Fd1d2,P>  - <v  jCs^d^ ,?•>  depends  on  p and 
q as  illustrated  in  Fig.  3.4.  As  we  might  expect,  if  correlation  is 
high  enough  the  sum  of  the  values  of  individual  information  will  ex- 
ceed the  value  of  joint  information. 


CASE  5:  COMPLETE  INFORMATION  - PERFECT  FLEXIBILITY  ON  dl 

a2 

<v jCs. s?Fd1 ,£>  ■ max  E(max  v)  = c 1 
d£  4 

2 2 2 2 
a 1 al+ 2a  1 a 2 p al  a2+a  2 a2 
* 4 ’ 


(3.1.27) 


d* 


alSl+a2S2 


- and  d*  = 0 


(3.1.28) 


The  value  of  flexibility  on  d^  , that  is  the  value  of  choosing  the 
quantity  of  output  one  after  input  prices  become  known,  varies  di- 
rectly with  the  variance  of  the  cost  of  output  one.  Retaining  flex- 
ibility on  the  quantity  of  output  one  is  a means  of  compensating  for 
cost  changes  in  that  output,  the  optimum  rule  being  to  decrease  output 
by  one- half  of  the  net  increase  in  output  costs.  The  value  of  that 
compensation  ability  varies  directly  with  uncertainty  in  the  quantity 
to  be  compensated  for.  The  more  uncertain  a variable  for  which  we  may 
compensate,  the  more  valuable  is  the  compensation.  Notice  that  the  re- 
sult is  independent  of  the  degree  of  interaction  q between  the  deci- 
sion variables. 


CASE  6:  COMPLETE  INFORMATION  - PERFECT  FLEXIBILITY  ON  d2 


By  symmetry 


*^v  |Cs  is2Fd^  ,£> 


.2  2 ,2  2 

b 1 CT1+  lb  2 D01  a2'*’b  2 °2 

4 


(3.2. 29) 


Comparing  (3.1.27)  and  (3.1.29)  we  see  that  it  is  more  valuable  to  re- 
tain flexibility  on  the  output  whose  costs  are  more  variable;  that  is, 
other  things  being  equal,  compensation  should  be  reserved  for  variables 
whose  values  are  most  uncertain.  Subtracting  (3.1.27)  and  (3.1.29) 
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from  (3.1.16), 


<vlCsls2Fdld2,e>  ' <v|Cs1s2Fd1,e>  - <v|CSls2Fd2,e> 

2 2 2 2 
q a + 2qr<r  a +q  a 

. C1 L1  C2  c 2 

4(1  - q2) 

(q2a2+2qa1b1+q2b^)g^  + 2[q2aLa2+q(a1b2+a2b1)+q2b1b2]  pg^ 

4(1  - q2) 

(q2a2  + 2qa„b  +q2b2)CT2 

+ — — . (3.1.30; 

4(1  - q^) 

As  a function  of  the  interaction  coefficient  q this  appears  as  in 
Fig.  3.5.  Observe  that  if  there  is  no  interaction  between  the  decision 
variables  (q  = 0)  , then  the  value  of  flexibility  on  d.^  and  d2 
equals  the  sum  of  the  individual  values  of  flexibility  on  dL  and  on 
d2  . If  the  input  cost  random  variables  are  such  that  there  is  no  cor- 
relation between  output  costs  (r  - 0)  , then  the  value  of  flexibility 
on  both  d^  and  d2  is  at  least  as  valuable  as  the  sum  of  the  values 
of  flexibility  on  each  individual  decision  variable.  In  general,  how- 
ever, the  value  of  flexibility  shares  that  same  (perhaps  somewhat  per- 
plexing) characteristic  of  the  value  of  information;  <v  |Cs1s2Fd^d2,g> 
may  be  greater  than  or  less  than  the  sum  of  <v  |Cs1s2Fd]L  ,£>  and 
<v|Cs1s2Fd2,C>  . The  sign  of  <v fCs^Fd^ ,e>  - <v Fd  ,g>  de- 
Pends  on  o and  q as  illustrated  in  Fig.  3.6.  If  decision  variable 
interaction  is  high  enough,  we  can  expect  the  value  of  joint  flexibility 
to  exceed  the  sum  of  the  values  of  individual  flexibility. 

CASE  7:  PERFECT  INFORMATION  ON  s^  - PERFECT  FLEXIBILITY  ON  dj^ 

<v|Cs1Fd1,e>  - max  E[max  E(v|s,)] 
d2  si  dl  s2 

2 

o 2 2 2 2 2 2 

_ n 2,  a2  2 

4 ' (L_P  > ~ °2 4 ” • (3.1.31) 
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FIGURE  3.6  THE  SIGN  OF  ^ICs^Fd^.O  - CvICs^Fc^ ,C>  - CvICs^  Fd  ,C>  AS  A 
FUNCTION  OF  p AND  q FOR  THE  FOUR-VARIABLE  PRODUCTION 
PROBLEM 


and  d*  ■ 0 . 


(3.1.32) 


df  - 


ai+a?P  — 
1 2 ^ 


Subtracting  (3.1.31)  from  (3.1.27), 


<v  CSls2Fd1>e>  . <v|CSlFd1>e>.  (1-  o2)  4 ■ (3.1.33) 


4 °2 


The  value  of  clairvoyance  on  and  over  clairvoyance  on 

when  that  information  may  be  used  only  in  setting  dl  is  independent 
of  the  interaction  q and  the  parameters  describing  process  number 
two.  It  is  smaller  the  stronger  the  correlation  0 


CASE  8:  PERFECT  INFORMATION  ON  Sj^  - PERFECT  FLEXIBILITY  ON  d. 

By  syronetry, 


o o 

<v|Cs1Fd2,e>  - (l-p2)  -1  a2 


2 2. 


2 2 2 


)1<71+2b1b2prTiCT2+b2p  a2 
4 


(3.1.34) 


3-2  THE  N x m quadratic  decision  problem 

In  this  section  we  shall  generalize  the  results  on  the  foui>vari- 
able  quadratic  problem  to  the  case  of  a quadratic  decision  problem 
with  any  finite  number  of  state  and  decision  variables.  We  take  for 
our  general  framework  the  basic  decision  model  of  Fig.  1.4  with  the 
following  additional  assumptions: 

1.  The  decision  variables  d are  unconstrained,  < d.  < ^ . 

2.  The  decision  maker's  value  function  v(s,d)  is  a quadratic 
function  in  the  s.  and  d^  such  that  for  every  _s  , v(s,d) 
has  a unique  maximum  with  respect  to  d 

3.  The  decision  maker's  utility  function  is  a linear  function  of 
value . 

We  may  think  of  the  quadratic  value  function  as  an  approximation  to 
an  arbitrary  smooth  value  function  v(s,d)  as  follows.  Expand  v(s,d) 

in  a Taylor  series  about  the  point  o - (s°,d°)  neglecting  higher  order 
terms: 
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’(s,d)  « v(s,d) 


— . o .o.  V 
v(s  ,d  ) + — 

1 

L 


* v 


iJ 


(s  .-s?)  (s  ,-s°) 

. i i/v  j y 


L , r^d  . 


1J 


1 J 


(s.-s°)(d.-d°)  +y^- 


(d.-d°) 
. J J 


i y A 


2 L . od  . 

ij  1 J 


<d i~ di ) <d  j- d j ) • 


(3.2.1) 


By  suitably  defining  the  real  number  a , vectors  b and  _r  , and  ma- 
trices W , T , and  Q , this  may  be  written 

v(s,d)=a  + b,s-f-^s'Ws  + s'Td+2,d+^d'Qd  , (3.2.2) 


where 


_ -2~ 

r n v 


\s  . 9d  . 

* 1 J 


-^•*1  > • • • >n>  j*l> . . . ,m 


(3.2.3) 


is  a matrix  whose  elements  measure  the  interaction  between  various 
state  and  decision  variables,  and 


.2- 


f - *— 

^ V 

J^cl.ocl 


• • • ,n,  j«l m 


(3.2.4) 


is  a symmetric  matrix  measuring  the  interaction  between  decision  vari- 
ables. Assumption  (2)  above  implies  that  Q is  negative  definite. 

AN  EXPRESSION  FOR  THE  EVPIGPF 

We  are  interested  in  comparing  alternative  information  with  flex- 
ibility structures  in  terms  of  the  maximum  expected  payoff  that  can  be 
derived  from  their  use.  To  characterize  the  various  structu.es  we  use 

the  following  notation.  Let  N-{1 n)  and  M ■ { 1 , ...  ,m  J be 

the  respective  sets  of  state  and  decision  variable  indices.  Define 
IC  N to  be  the  set  of  indices  of  those  state  variables  upon  which 
information  is  to  be  obtained,  and  let  JC  M denote  the  indices  of 
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decision  variables  for  which  flexibility  is  available.  I and  J will 
denote  the  complements  within  N and  M of  the  nets  I and  J,  re- 
spectively. CSjFdj  will  denote  the  information  structure  within  which 
the  decision  maker  has  clairvoyance  on  state  variables  s,  , i e I 
and  flexibility  on  decision  variables  d.  , j fi  J , 

It  will  be  convenient  to  take  as  the  origin  for  measurement  of  ex- 
pected payoff  the  maximum  expected  payoff  for  the  null  system  which 
provides  no  information  nor  flexibility.  Because  of  assumption  (3) 
above,  the  value  of  an  information  with  flexibility  structure  Cs  Fd 
will  be  given  by 


^Cs  Fd  ^ICSjFdj,^  - <V|P>  . (3.2.5) 

I 3 

Since  we  will  be  interested  only  in  the  relative  values  of  using 
various  information  structures,  we  ignore  the  first  three  terms  in 
(3.2.2).  We  shall  also  find  it  convenient  to  measure  the  decision  vari- 
able setting  as  a deviation  from  the  best  deterministic  decision  rule; 
that  is,  from  the  decision  setting  that  would  be  optimal  if  state  vari- 
ables were  to  take  on  their  expected  values.  Replacing  s by  E(s) 
and  setting  the  gradient  of  (3.2.2)  to  zero,  we  get 


d - -Q  1 [T'E(s)  + r]  . (3.2.6) 

Defining  5d  as  the  deviation  from  the  deterministic  optimum, 
d - d + 6d  , the  value  function  (3.2.2)  may  be  written 


v * [s  -E(s')]  T 5d  + 2 Sd'Q  5d  + terms  independent  of  5d  . 

( 3 • 2 • 7) 

Thus,  there  is  no  loss  in  generality  if  we  take 

v(s  ,d)  ■_s'T_d+-^_d'Q_d  (3.2.8) 

E(_s)  0 , if  state  variables  are  assumed  to  be  measured  from 

their  mean  values  and  decision  variables  are  assumed  measured  as  devia- 
tions from  the  values  that  would  be  optimal  if  state  variables  were  at 
their  means. 
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In  order  to  state  the  major  theorem  of  this  section  we  need  to  de- 
fine some  supplemental  notation.  For  a given  structure  Cs  Fd  , let 

i.  J 

T denote  the  matrix  [t..].  _ . T of  those  elements  t..  of  T 
IJ  ij  ij 

such  that  i is  in  I and  j is  in  J , and  similarly  define  T^j  , 
Qjj  > , etc.  and  will  be  taken  to  mean  the  transpose 

of  Tnj  and  the  inverse  of  respectively.  Also,  let  _s  denote 

the  vector  of  those  components  of  _s  such  that  i e I , and 

similarly  define  _d^  and  _d-j  . Then,  subject  to  the  various  assump- 
tions made  above,  we  have  the 


THEOREM: 


For  any  information- flexibil ity  structure  Cs  Fd  , the 

I J 


optimal  decision  strategy  _d*  is  given  by 


4 ’ ' 


(3.2.9) 


(3.2.10) 


and  the  corresponding  expected  value  of  the  structure  is 


"*  |6>"  - ^ traceKjQ"jJTNJE(^’) 


C5IFdJ 


l 


'(tTj‘tijq"jjqjj) (Qjj-QjjQjiQjj)’ 1 (Ttj'SjQjjTij)E(^I)E^i)}  > 

(3.2.11) 


whe 


re  x ■ E(s  |_s ^.)  . 


PROOF:  We  first  note  that  the  expected  payoff  using  the  null  structure 

is 


<"viC>  = max  E (v)  = max  (4  _d'Q  ji)  ■ 0 , 


(3.2.12) 


since  Q is  negative  definite.  Therefore,  the  value  of  the  struc- 
ture CSj.Fdj  will  be  <v|Cs].FdJ,P>  . Now, 


<v  jCs  jFdj  ,£>  ■ max  Efmax  E(v|_s^)] 


max 

* 


E|max[x'TNJdJ+x,TNJdJ+2 ijQjjdj+AjO^^dj  + 2 — ]}  ’ 

(3.2.13) 


where  _x  ■ E(sjsj)  denotes  the  vector  of  conditional  means.  Since 
Q is  negative  definite,  the  submatrix  Q is  negative  definite 

J J 

also.  Taking  the  gradient  with  respect  to  dj  of  the  quantity 
within  the  inner  bracket  and  setting  the  result  equal  to  zero  we 
obtain 


• 


(3.2.14) 


Substituting  (3.2.14)  into  (3.2.13)  gives 

<"lCsIFdJ.«>  - 

-2j 

+ 2 -^j(Q73~03JQJJQJJ)-^r}  • 


(3.2.13) 


Let  us  denote  the  inverse  of  Q by  R and  partition  R in  con- 
formity with  the  partitioning  of  Q . Then  we  have 


QJJ  QJJ 


RJJ  RJJ 


RJJ  **33 


which  leads  to  the  equations 


I 

0 


(3.2.16) 


QJJRJJ  + QJJRJJ 


QJJRJJ  + ^JJ1^ 


^j^jj  + bj^jj 
bjjRjj  + ^j^jj 


i , 
o , 

0 , 

1 , 


(3.2.17) 
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t 


in  which  I and  0 denote  identity  and  zero  matrices  of  appro- 
priate dimension.  Solving  these  equations  for  the  elements  of  R 
leads  to  the  equations 


(QJJ_QJJQjjQJJ) 

“qjjqjjrjj  “ “RjjQjj<bj 
■qI3qjjrjj  " "RnQjjQjj 


(3.2. 18) 


These  relations  are  symmetric  in  that  we  can  exchange  the  symbols 
R and  Q . For  example,  1 

Using  (3.2.18),  (3.2.15)  may  be  written 


^IcsjFdj.es  - - -1 


- \ _^3)  . (3.2.19) 


Since  Q is  negative  definite,  so  is  R , and  therefore,  so 
are  R-j-j  and  R—  . Hence,  the  maximization  in  (3.2.19)  may  be 
achieved  by  differentiation.  We  obtain 


- -(RJJTNJ  + RJJTNj>E^ 


- -R^T  E(x) 


(3.2.20) 


Substituting  this  expression  into  (3.2.14)  and  (3.2.19)  yields 


4?  ■ + <5j>j3RjjTNJ  + IrfWib1®® 

* -O'j'Aj?  + ' Qj/.0TNjlE® 


-«jjTNJ[5  - Et!)]  - «™T’E(2) 


(3.2.21) 


and 


-1 


^CSjFdj.O  - - \ iE(x')TRMlRliR-5MI’E(K)  , 


or,  since 


*!  = EC=!  lsx)  = , E(Xj)  = 0 


(3.2.22) 


^ = -RjMTIME<^f)  ’ (3.2.23) 


-j  = _QJJTi^I  - QjjTij[^I  - E(^i)?  - E(xj)  , (3.2.24) 

' - |trace{lNJQ-]Ti;jE(s')+  T-j/^R^T^E^E^)}.  .(3.2.25) 


Finally,  (3.2.23),  (3.2.24),  and  (3.2.25)  may  be  put  in  the  form 
of  the  theorem  using  the  identities 


RJMTIM  " RJJTIJ  + RJjTIj 


RJJ(TIJ  + RJJlRJj ^ “ Rjj<TIj  - . 

(3.2.26) 


Vim  rjjtij  + RjjTij 


+ r33rJjtTj>  - "33<TtI  - <bj«jX,>  ' 


JJ''JJ1IJ'' 


(3.2.27) 

rjj  c (Qj.r<!jjf!ijQjj)  ’ 

(3.2.28) 

*33  * • 

(3.2.29) 

QED. 


The  decision  problem  that  the  theorem  solves  is  illustrated  in 
Fig.  3.7.  It  is  interesting  to  observe  that  a form  of  the  certainty 
equivalence  principle  continues  to  apply.  If  _s  were  known  exactly, 
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the  optimum  setting  for  d-  would  be 

J 

-5  ■ •w'i  ■ 

(3.2.30) 

If  we  replace  _s  by  its  prior  expectation  (_0,E(xj)]  , 

we  get 

(3.2.31) 

which  by  (3.2.23)  is  the  optimal  setting  under  uncertainty.  Given  this 

setting  for  d-j  , the  optimal  setting  for  d given  s 

would  be 

-*  ■ -qjjtnj2  + - IjM'VOil)  ■ 

(3.2.32) 

Replacing  j with  its  posterior  expectation  [s-,x-] 

we  obtain 

Eq.  (3.2.24),  1 1 

-J  " "qjjtij^:  " qjjtTj[^TE(^t)]  - 

, (3.2.33) 

the  optimal  setting  for  dT  . 

— J 

COROLLARY  J.:  Under  the  structure  Cs  Fd 

I J 

4j ' 2 • 

(3.2.34) 

■ 

(3.2.35) 

<VcsIF<1J|e>  ' ' 2ltr“e{TNJ<}j]'INJE<S’)} 

(3.2.36) 

if  any  of  the  following  conditions  hold: 

(a)  ■ _0 

(b)  J * 0 (Complete  flexibility) 

(c)  I ■ 0 (Complete  information)  . 

PROOF:  For  condition  (a)  the  proof  follows  trivially  from  (3.2.23), 

(3.2.24),  and  (3.2.25).  That  the  reduction  results  for  conditions 
(b)  and  (c)  is  easily  deduced  by  reviewing  the  proof  for  the  above 
theorem  under  each  condition.  QED. 
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COROLLARY  2:  Under  the 

structure  Cs  Fd 
J.  J 

ib  "-2  • 

(3.2.37) 

-j  “ '°jj1ij^i  ’ 

(3.2.38) 

"^Cs  Fd 

!e,>  - - ^trace^jQjJr^E^j.s;)} 

> 

(3.2.39) 

if  any  of  the  following  conditions  hold: 

(a)  Xj  - 0 

(b)  Xj,,  - to] 

(c)  E(x-j)  -0  and  T— ^ = [0]  . 

PROOF:  The  proof  follows  by  direct  substitution  into  (3.2.23),  (3.2.24), 

and  (3.2.25).  QED. 

ADDITIVITY  CHARACTERISTICS  OF  THE  EVPIGPF 

For  the  following  two  corollaries  we  shall  assume  in  addition  that 
the  conditional  expectation  of  j>  is  a linear  function  of  the  observ- 
able state  variables.  Condition  (a)  of  Corollary  1 holds  in  this  case; 
we  may  generalize  two  of  the  results  obtained  in  the  four- variable 
quadratic  example  of  Section  3.1. 

COROLLARY  3:  Suppose  the  random  variables  composing  the  vector  _Sj 

upon  which  clairvoyance  is  available  may  be  partitioned  into  two 
vectors  and  that  are  independent.  Then 


, le>  - <v„_  |e>+<v  |e>  . 


csIFdJ 


csIlFtlJ 


Csl2FdJ 


(3.2. 40) 


PROOF:  By  assumption,  x ■ E(s[s^)  = D_s^  for  some  matrix  D . Denot- 

ing the  covariance  matrix  of  _s^  by  C , (3.2.36)  becomes 


■ - ltrace{B'INJQJJ 


jtnjdcii}  ' 


(3.2.41) 

For  convenience  in  what  follows  we  shall  assume  that  the  variables 
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have  been  ordered  so  that 


-II 


-12 


-I 


The  independence  of  _s^  and  _s  imply 


(3.2.42) 


'IT 


C 


nil 

0 


'1212 


(3.2.43) 


D = 


I 

0 

D, 


0 

I 

D„ 


(3.2.44) 


where  I and  0 are  identity  and  zero  matrices.  Similarly,  with 

E(sL§n)  = D^1^n  antI  ^x2 


I ~ 

" 0 ” 

- 

0 

, »(2)  = 

I 

D. 

D„ 

1 

2 

(3.2.45) 


Finally,  defining  I!  ■ with  appropriately  partitioned 

submatriccs  H.  . ; 

ij 


— trace  (D’  IIDCjj) 


r 


0 D 

1 D 


H11  U12  H13 
H2l  !!22  !123 
H31  U32  !l33 


I 

0 

D, 


0 

I 

D, 


mi 

o c 


0 

1212 
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[Hll+H13Dl+D;<"31+H33Dl>]cim  ' 

’[1I22+H23D2+D2<H32+H33D2)  Jl2I2 

(3.2.46) 

VcsllFdJ  |E>  ’ ‘ 2ltrace{D<1>,HI>U)cilIl} 

- - ]trace{[Hu+l,13D1+D;(H31+H33D1)]:ilI1}  , (3.2.47) 

4cSI2Fdjle>  ' ' 2ltr£,ce{D(2),™(2,CI2I2} 

' • 2traCe{[,122+H23D2+D2(H32+H33D2)]CI2I2}  ' t3'2'48) 

(3.2.40)  follows  from  a comparison  of  (3.2.46),  (3.2.47),  and 
(3.2.48).  QED. 

Following  the  example  of  Section  3.1,  we  say  that  decision  vectors 
— ji  anc^  J?j2  not  interact  if  the  value  function  may  be  expressed  as 

v<s;djl>dj2>ij)  - vi^ji>i3>  + v2(s;dJ2,dj)  . (3.2.49) 

COROLLARY  4:  Suppose  the  decision  variables  composing  the  decision 

vector  ^lj  for  which  flexibility  is  available  may  be  partitioned 
into  two  vectors  _dj^  and  _d  that  do  not  interact.  Then 

+ ^CSlFdJ2lE>  ' (3.2.50) 

PROOF:  For  convenience  we  assume  decision  variables  are  ordered  so 

that 


1 

-^trace 


d = 


(3.2.51) 
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For  the  quadratic  value  function,  the  non-interaction  assumption 


means  that  the  matrix  has  the  diagonal  form 


CJJ 


‘J1J1 

0 


'J2J2 


(3.2.52) 


Then  using  (3.2.41), 


^Cs  Fd  lR> 

J_  J 


QED. 


4traceJl)'|T  , T I 
2 1 LNJ1’  NJ2j 


,-l 


J1J1 
0 Q 


0 

-1 


- itr‘“:e(D"rNJlQjLlTNJlBCIl) 


' -2tra“<D' Wj2J2TNJ2MII> 
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J2J2 


NJl 

„ i 


NJ2 


Dcn} 


(3.2.53) 


CHAPTER  4 

QUANTIZED  INFORMATION  AND  DISCRETIZED  DECISION  SYSTEMS 

In  Section  2.3  the  topic  of  evaluating  imperfect  information  given 
partial  flexibility  was  discussed.  That  discussion  might  have  led  the 
reader  to  piesume  that  a decision  maker  would  never  prefer  to  use  im- 
perfect information  or  partial  rather  than  complete  flexibility  in  his 
decision  model.  Quite  to  the  contrary,  perfect  information  will  typi- 
cally be  evaluated  as  if  it  were  imperfect  quantized  information,  and 
complete  flexibility  will  usually  be  treated  as  if  it  were  only  partial 
discretized  flexibility. 

The  reason  for  this  is  that  quantization  of  information  and  dis- 
cretization  of  decisions  can  provide  the  simplification  necessary  to 
reduce  a complex  decision  problem  to  a computationally  manageable 
size.  The  application  of  this  principle  is  so  common  that  it  is  likely 
to  be  taken  for  granted.  Information  is  usually  expressed  numerically 
or  otherwise  categorized  and,  therefore,  by  necessity  it  is  "rounded 
off."  Similarly,  our  decisions  are  frequently  constrained  to  be  some 
multiple  of  a common  number  or  unit:  dozens,  cases,  minutes,  etc. 

Quantization  allows  us  to  reduce  an  infinite  number  of  possibilities  to 
a finite  number  with  which  we  find  it  easier  to  deal. 

By  the  same  principle,  if  the  decision  analyst  treats  his  contin- 
uous or  many- valued  state  variables  as  if  they  were  roughly  quantized, 
and  his  continuous  or  many^  valued  decision  variables  as  if  they  were 
crudely  discretized,  he  can  frequently  achieve  an  enormous  simplifica- 
tion in  his  decision  model.  For  this  reason,  information  and  flexibil- 
ity will  typically  be  accounted  for  by  artificially  quantizing  state 
variables  and  artificially  discretizing  decision  variables  in  a very 
rough  manner. 

The  purpose  of  this  chapter  will  be  to  investigate  the  consequences 
of  introducing  quantization  into  a decision  model.  The  first  sections 
address  the  issue  of  quantizing  continuous  valued  state  variables;  the 
latter  section,  discretizing  continuous  decision  variables.  Our  objec- 
tive here  is  by  no  means  meant  tp  be  a thorough  investigation  of 


quantization  in  decision  analysis.  Rather,  we  address  the  problem  more 
as  a necessary  side  issue  of  our  study  of  the  value  of  information- 
flexibility  structures. 

4.1  STATE  VARIABLE  QUANTIZATION 

We  begin  by  considering  once  again  the  basic  decision  model  of 
Fig.  1.4.  If  the  value  of  the  state  vector  _s  was  anticipated  to  be- 
come known  to  the  decision  maker  prior  to  his  setting  of  the  decision 
vector  _d  , the  utility  of  the  decision  problem  (before  _s  is  revealed) 
and  the  optimum  decision  strategy  are  found  by  solving  the  functional 
optimization  problem 

<u|e>  ■ f max  <Li[s,_d,E>  fsjg]  . (4.1.1) 

sgS1'  d s D 

Solution  of  (4.1.1)  yields  an  optimal  decision  function  d*(-)  which 
maps  the  state  space  S into  some  subset  of  the  action  set  D . Cal- 
culation of  such  a decision  function  is  necessary  in  problems  for  which 
optimization  after  the  receipt  of  information  is  impractical  or  in  prob- 
lems for  which  the  setting  of  the  decision  vector  _d  conditional  upon 
_s  is  part  of  the  evaluation  of  a larger  decision  strategy. 

For  several  reasons,  however,  the  functional  optimization  indi- 
cated in  (4.1.1)  is  rarely  performed  in  practice.  In  many  cases  be- 
cause of  accounting  problems,  the  precise  value  of  _s  will  not  be 
reported  to  the  decision  maker.  Rather  its  value  will  be  rounded  off 
to  a more  convenient  number.  In  other  situations  the  functional  opti- 
mization required  in  (4.1.1)  may  be  too  difficult  to  perform;  it 
will  be  far  simpler  to  execute  the  optimization  in  a decision  tree  in 
which  the  distribution  of  _s  has  been  approximated  by  a probability 
mass  function.  Thus,  we  often  find  that  practical  matters  lead  us  to 
quantize  a random  variable. 

State  variable  quantization  in  decision  models  is  usually  accom- 
plished by  artificially  concentrating  the  continuously  distributed 
state  variable  probability  mass  on  certain  discrete  points  chosen 
within  the  state  space  S . This,  however,  causes  some  problems.  Af- 
ter the  decision  strategy  has  been  formulated  and  it  comes  time  for  the 
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FIGURE  4.1  COMPLETE  DECISION  MODEL  AND  SIMPLIFICATION 
RESULTING  FROM  QUANTIZATION 
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decision  maker  to  set  _d  according  to  an  optimal  decision  strategy 
d*( ’ ) > the  observed  value  of  _s  may  not  even  correspond  to  any  of  the 
discrete  levels  for  which  the  decision  rule  was  calculated.  In 
such  situations,  the  decision  maker  is  likely  to  use  the  optimal  deci- 
sion setting  corresponding  to  the  "closest"  quantized  level.  We  forma- 
lize this  last  thought  by  imagining  that  a partition  PN  « N,  has 

S i J i_*l 

been  formed  on  the  set  S of  possible  states  of  Nature.  The  action  of 

the  quantized  information  system  is  such  that  if  s e S.  , the  index  i 

— 1 

is  communicated  and  made  available  for  the  decision  process.  Correspond- 
ing to  each  subset  the  decision  maker  must  find  the  decision  set- 

ting _d*(i)  that  maximizes  the  expected  utility  given  only  that  ^ e S.- 
The  complete  decision  model  and  the  simplification  achieved  through 
quantization  are  illustrated  in  Fig.  4.1.  Notice  that  not  only  has  the 
information  system  been  simplified,  but  specification  of  the  optimal 
decision  strategy  requires  only  the  specification  of  the  N vectors 
d*(l) , . . . ,d*(N)  , not  the  specification  of  a vector  of  functions  d*(-) 
on  S . Specifically,  if  _s  e the  optimal  decision  setting  maximizes 
the  conditional  expectation 


*^*u  | s e S.,d.,e>»  1 -u|s,d,e>  '_s|s  eS.,e]  , i-l,...,N  , (4.1.2) 

s c-S  V 1 

— ~ i 


where 


^ e S.,61  . s ES. 


(4.1.3) 


is  the  conditional  distribution  of  s given  that  s lies  in  subset 


S . and 
i 


[s  e s.  |e}  - J £s  je} 

_s  e S * 


(4.1.4) 


is  the  probability  that  _s  lies  in  . Hence,  to  the  partition 

and  given  model  ,D,  (s  |C},v,u  j-  will  correspond  an  expected  utility 

N n 

N V - 

'"u|ps>£>"  ) max  f <u  j_s,_d,e>  f_.5  le} 

i«l  p dgD  sgS^ 

(4.1.5) 


-66- 


EVALUATING  A QUANTIZING  SCHEME 


Suppose  that  quantized  information  may  be  purchased  at  a price 
p^  . If  u|P>  is  the  expected  utility  given  no  information  on  _s  , 
and  <u|P^,p^,E>  is  the  expected  utility  given  that  the  quantized  in- 
formation system  is  purchased  at  a price  p^  , we  define  the  price  p^ 
such  that 

<u|P^,p1,t;>  - <u!e>  (4.1.6) 

N » N 

to  be  the  value  of  the  partition  Pw  and  denote  this  value  by  V(P  ) . 

s s 

Similarly,  suppose  that  complete  (exact)  information  could  be  purchased 
at  a price  , and  let  -'u  ICj;  ,P2  ,P>  denote  the  maximum  expected  util- 

ity if  this  purchase  is  made.  We  define  the  price  P2  such  that 

<ulCs,p2,P>  « oi  |pN,<*>  (4.1.7) 

as  the  loss  associated  with  using  the  particular  quantization  scheme 
P^  . We  denote  this  quantity  by  i(Pg)  . v’(Pg)  may  be  interpreted  as 
the  maximum  amount  of  money  the  decision  maker  would  be  willing  to  pay 
for  the  use  of  the  quantized  information  system.  We  interpret  £(Pj?) 

D 

as  the  economic  loss  a decision  maker  with  a complete  information  sys- 
tem would  have  to  sustain  to  make  him  indifferent  between  retaining  it 
(the  complete  information  system)  and  accepting  instead  the  quantized 
system. 

The  number  of  subsets  N comprising  the  partition  P^  determines 
the  level  of  quantization.  Several  possible  levels  of  quantization  are 
illustrated  in  Fig.  4.2.  Notice  that  for  N ■ 1 we  have  the  situation 
of  Fig.  2.1,  and  the  loss  of  the  quantized  system  is  just  the  value  of 
perfect  information  on  _s  given  perfect  flexibility  on  d , As  N 
goes  to  infinity  the  quantized  system  approaches  the  complete  model  in 
which  information  and  flexibility  are  available.  Thus,  the  decision 
models  with  and  without  flexibility  can  be  thought  of  as  the  two  ex- 
tremes of  a collection  of  models  which  piece- wise  approximate  the  op- 
timal decision  strategy  over  the  state  space. 

Because  calculation  of  the  optimal  strategy  for  the  quantized 
model  is,  in  principle,  easier  than  that  for  the  complete  model,  two 
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important  questions  emerge:  First,  wliat  i;.  the  value  of  a particular 

level  of  quantization?  Second,  given  that  the  level  N of  quantiza- 
tion is  fixed,  how  should  the  partition  pN  « |s.l  ,N,  be  determined? 

js  1 1 J t*l 

Equations  (4.1.5),  (4.1.6),  and  (4.1.7)  move  us  an  important  step  to- 
wards answering  these  questions.  We  can  compare  the  relative  advantage 
of  using  various  quantizing  schemes  by  comparing  their  expected  utili- 
ties and  associated  values  and  losses.  Fixing  N , we  can  choose  the 
quantizing  partition  P‘^  ■ ^ so  as  to  maximize  this  advantage. 

We  apply  these  ideas  to  the  entrepreneur's  price  and  quantity  decision 
in  the  example  below. 


6.2  QUANTIZING  THE  COST  VARIABLE  IN  THE  ENTREPRENEUR ' S DECISION 

Suppose  for  the  entrepreneur's  problem  of  Section  2.2  that  infor- 
mation is  available  on  the  cost  variable  c . The  decision  maker  must 
choose  between  using  the  complete  model  and  the  N-partition  model  of 
Fig.  4.3.  We  wish  to  determine  the  economic  loss  to  be  expected  from 
using  various  levels  of  quantization,  and  we  wish  to  design  the  quantiz- 
ing  partitions  in  such  a way  so  as  to  minimize  this  loss. 


TWO- LEVEL  QUANTIZATION 

The  possible  values  for  per  unit  production  costs  c are  parti- 
tioned into  two  sets  by  the  point  yj  If  0 c ■'  y^,  costs  are 
"low"  and  an  appropriate  price  p ami  quantity  q are  to  be  deter- 
mined. If  yj  < c ' 1,  a price  and  quantity  are  chosen  that  are  ap- 
propriate for  "high"  costs.  The  expected  payoff  using  such  a strategy 
is  given  by 


^ l-N  „ f 

<vlP  ,£>  » max  max  i 

c _ c. 


yi  i 


pi  qi  eo 


--v|p,q,c,e,r  'e  l.”)'c  lp  i 

1 1 


4 max  max 

c . c. 

p2  q2  yj  6 


''v  lp,q,c,e,f->  re  lp}fc  Ip] 
2 y.  2 


max  maxjy  fa+ba-(b*  y-  + 4)p-  4“  +(a-  -y)q-pbq-  -E3-]  \ 

?l  qt  l Zp  2 J 

4-  max  max  |(l-y1)(a-fba-(b+  — + -^)p-  y-  +(a y^)q-pbq- 

p2  q2  1 2 J 


h2. 
(6.2.1) 
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Differentiating  to  perform  the  maximizations  we  obtain  the  decision 
rule 


2a-y j- 2pb 

2;  ’ 

2a-  (l+y1)-2pb 

2p 


■r-v 


^y1-y1 

8M-4 


4a(l+yi)-(l+yL)‘ 

8b+4 


(4.2.2) 


(4.2.3) 


and  a corresponding  maximal  expected  payoff  of 


„ \ & , b \/ 2b+l 

<v!pc(yi)»e>  - a + — 


(4a-y1)^2yJ/2+(4a-l-y1)1/2(l-y1)  . 


1/2, 


(4.2.4) 


Notice  that  for  y1  » 0 or  y^  * 1 , Eqs.  (4.2.2),  (4.2.3),  and 
(4.2.4)  reduce  to  Eqs.  (B.4)  and  (B.5)  of  Appendix  B.  This  makes  sense 
when  we  interpret  the  latter  equations  as  corresponding  to  a one- 
partition  quantization  of  costs. 

If  the  organizer  sets  y^  ■=  1/2  , the  state  space  is  partitioned 
in  half  and  the  maximum  amount  of  information  is  conveyed  by  the  quan- 
tized information  system.  In  this  case,  plugging  y^  = .3  , a «=  2.25, 
and  b ■ .5  into  (4.2.4)  gives 


^|p^,e,  * $585,277  , (4.2.5) 

which  is  $85,139  better  than  if  no  information  on  costs  is  provided, 
and  $54,139  short  of  the  value  produced  with  the  complete  information 
system.  However,  from  (4.2.4)  we  see  that  the  best  two-state  informa- 
tion system  is  obtained  by  choosing  y^  so  as  to  minimize 

(4a-yi)1/2yi3/2  + (4a-l-y1)1/2(l+>l)1/2(l..y1) 

- (9-y1)1/2y13/2+(8-y1)1/2(l+y1)1/2(3.-y1)  . (4.2.6) 

The  value  of  y^  that  minimizes  this  expression  is  approximately 

y1  - 0.35165  . (4.2.7) 
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Thus,  the  best  two- level  quantizing  scheme  for  a strategy  contingent 
only  on  the  information  "costs  are  high"  or  "costs  are  low"  would  be 
achieved  by  defining  costs  as  "high"  or  "low"  according  to  whether  or 
not  they  exceed  $351.65  per  unit.  Plugging  (4.2.7)  into  (4.2.4)  we 
obtain  the  maximum  expected  payoff  if  a two-partition  information  sys- 
tem is  used  for  costs: 

<V!Pc2’e>max  " $592’328  • (4.2.8) 


N- LEVEL  QUANTISATION 

Define  yg  ■ 0 and  y^  - 1 and  assume  that  the  information  sys- 
tem quantizes  the  cost  variable  c into  N intervals  the  ith  of  which 
is  bounded  by  the  points  y^_^  and  y^  . If  the  information  system 
reports  only  the  interval  into  which  costs  fall,  the  expected  payoff 
will  be 


•W-e> 


N 

V 

I \ 

i«l 


max  max 

PL  <U 


cj  eJ  <v|p,q,c,e,e>{e|?]{c  |£]  • 

yt-l  0 

(4.2.9) 


Differentiating  as  in  the  two- level  case  we  obtain  expressions  for  the 
optimal  prices  and  quantities  and  the  corresponding  expected  payoff. 


i V 8b+4 


2P? 


- b 


(4.2.10) 
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1/2  1/2 

(yi+Vi-i)  (Vi-yi.i) 


(4.2.11) 


Due  to  the  assumed  linearity  of  the  decision  maker's  utility  function, 
the  economic  loss  from  using  such  a quantizing  scheme  is 


(4.2.12) 
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Table  4.1  consists  of  numerical  evaluations  of  (4.2.10)  and  (4.2.12). 
The  calculations  were  made  with  a * 2.25,  b ■ .5  for  equal  interval 
partitions  and  for  the  optimal  quantizing  partitions  for  several  lev- 
els of  quantization  N . Figure  4.4  shows  a plot  of  quantizing  loss 

versus  the  number  of  quantizing  levels  N for  the  two  quantizing 

- 2 

schemes.  Notice  that  quantizing  loss  falls  roughly  as  N 

4. 3 QUANTIZATION  IN  THE  TWO- VARIABLE  QUADRATIC  PROBLEM 

In  this  section  we  shall  explore  the  effects  of  information  quan- 
tization on  a two-variable  quadratic  decision  problem  of  the  form  in- 
troduced in  Chapter  3.  For  such  decision  problems  we  are  able  to 
determine  necessary  conditions  that  an  optimal  quantizing  partition 
must  satisfy  and  to  evaluate  the  effects  on  quantizing  loss  of  using 
various  levels  of  quantization  and  various  suboptimal  quantizing 
schemes.  The  results  are  of  interest  because,  as  stated  in  Chapter  3, 
the  quadratic  function  is  frequently  a good  approximation  to  a complex 
value  function. 

Consider  the  simplest  quadratic  decision  problem  in  which  there  is 
a single  state  variable  s and  a single  decision  variable  d . We 
assume  that  the  decision  space  D is  the  real  line  R and  the  state 
space  S is  a segment  of  R . The  value  function  is  assumed  quadratic 
in  s and  d and  for  every  s to  attain  a unique  maximum  with  re- 
spect to  d . Then,  according  to  the  argument  of  Section  3.2,  by 
suitably  defining  origins  there  is  no  loss  in  generality  in  assuming 

v(s,d)  = tsd  + qd2  (4.3.1) 

2 

with  E(s)  * 0 , Var(s)  ■ c , and  q ^ 0 . 

Our  decision  maker  is  assumed  to  be  risk  indifferent  so  that 

basing  his  decisions  on  expected  payoff  is  equivalent  to  the  criteria 

of  expected  utility.  We.  suppose  that,  for  the  aid  of  the  decision 

maker,  a quantized  information  system  has  been  instituted  which  in- 

N f 1 N 

duces  a partition  Pg  ■ < j-  ..  on  the  region  S . The  maximum  ex- 
pected payoff  which  can  be  attained  using  this  information  system  is 
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TABLE  4.1 

Loss  and  Decision  Strategy  for  Various  Quantized  Information 
Systems  for  Costs  in  the  Entrepreneur's  Decision 


QUANTIZING 
LEVEL  N 


U A NT  l,  i I h'G 

OCHI.r  U 
PARTITION 
BCUKLAK1EJ 


DECIolOK  NULL 

price  in  thousands  of 
dollars  - quantity  in 
thousand 53  of  unite 


p* =1.000  q*=1.2>0 


Pi=-.728 

qj=2.243 


Pj-  .017 
q* =2.864 


p£= 1.186 
q2" 


p£= 1.137 
q£=  .885 


E jual 
Interval 


. 5335 
.6667 


Optima  1 

.1783 

.5207 


E:ual 

Interval 

.2500 

.5000 

.7500 


Optimal 

.1075 

.3175 

.6198 


Equal 

Interval 

.2000 
.4000 
. 6000 
.8000 


p|  = .601  p|= 1.000  pr =1.236 


q|=2.966  q^=1.250  q^=  .646 


Pj  = .'^3  p£  = .852  p* =1.192 
q*=4.378  q^=1.732  q^=  .7^9 


t(rj’) 


no 


FIGURE  4.4  QUANTIZING  LOSS  VERSUS  NUMBER  OF  QUANTIZING  LEVELS  IN  THE 
ENTREPRENEUR'S  DECISION 


whore  P. 

1 


is  the  probability  that  s falls  in 


i-1 


1 . 


S. 

1 


and 


Differentiating  in  order  to  find  rhe  maximizing  d^  , we  obtain 
decision  variable  setting  the  decision  maker  ought  to  use  if  he 
that  s falls  in  , 


di""qE^SlseSi^’  1 " ^ • >N  • 

Substituting  this  into  (4.3.2), 

<vlPs’e>  ■ ' 15  I Pulses.)2  . 

i-1 

Defining  as  the  conditional  variance  of  s given  that  s 

in  S . , 

t 


V.  - E(s2|s<;  S.)  - E(s  |s  e S.)2 


we  have 


<v|i^,e> 


2 K 

- Tc,  / P1tE(s2|se  S.)-  Vt] 
i-1 


- — n2  ( 1-—  \ V V \ 


2q 


i-1 


From  (3.2.39)  we  see  that  the  term  in  front  of  the  expression  in 
parentheses  is  just  the  value  of  clairvoyance  on  s: 
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(4.3.2) 
the 

learns 

(4.3.3) 

(4.3.4) 
falls 

(4.3.5) 

(4. 3.6) 
the 


Finally,  since  the  expected  payoff  given  no  information  on  s is  zero, 
the  value  of  the  quantizing  system  equals  the  expected  payoff: 


l'(Pg)  - l'(Cs)  (1-Lj^)  , 


(4.3.8) 


where 


L 


1 


N 

I 

i-1 


P.V. 

1 i 


(4.3.9) 


In  view  of  the  above,  we  see  that  choosing  the  quantizing  system 
so  as  to  maximize  expected  payoff  is  equivalent  to  solving  the  extremal 
problem  defined  by 


N 

inf  Y P V . (4.3.10) 

N u 1 

U S -s  i-1 

i-1 


Equivalent  forms  of  problem  (4.3.10)  have  appeared  in  several  papers 
dealing  with  grouping  problems  with  different  objectives  of  the  group- 
ing [2,3,4]. 

OPTIMAL  QUANTIZING  PARTITION 

It  is  a simple  matter  to  derive  the  optimal  quantizing  partition 
if  we  return  to  Eq . (4.3.4).  From  (4.3.10)  it  should  be  intuitively 
clear  (and  it  is  easy  to  prove)  that  the  optimal  partition  consists  of 
a breakdown  of  the  space  S into  connected  intervals.  Therefore,  let 
the  regions  Si  be  the  segments  (yi_  ^ ,yi>  with  yQ  < yl  <,  ...  ^ yN  , 
where  y^  nnd  y^  are  respectively  the  (possibly  infinite)  initial 
and  fin -U  points  of  the  region  S . Then  .f  f(s)  ■ {s  |g]  is  the 
density  function  describing  the  distribution  of  s , 

2 N a2 

<vips-e>-  -h  Ip:  • <4-3-u> 

i»l 


where 


w*mmm 


yi 


A.  = 
1 


V1 


s f(s)ds  . 


(4.3.12) 


If  we  wish  to  maximize  (4.3.11)  for  fixed  N , we  get  necessary  condi- 
tions by  differentiating  with  respect  to  the  yL  and  setting  deriva- 
tives equal  to  zero.  The  terms  of  the  sum  involving  y.^  are 


A2  A2 

_i  + -ill 

P. 

i l+l 


(4.3.13) 


Differentiating, 


4tll  . li  li  + li±l  ^i±l  \2  *i  Ali  Spt+1 

,yi-pt  W pi  5yi  P1  ^1 

i i+1 


i+1 


*•■$•&>  k te- • 


14) 


Noting  that 


A. 

i 


p7  “ lyi.j.  s < yi(f>  . 


(4.3.15) 


then,  since  f is  nonzero  on  S and  the  optimal  partition  consists  of 
contiguous  intervals,  (4.3.14)  implies  that 


yi  “i(<Siyi-l  " s 


yi,f>+  'sjy.  - s <y.+1,e>)  . (4.3.16) 


Thus  for  the  two-variable  quadratic  decision  problem, the  optimal  par- 
tition is  independent  of  the  parameters  of  the  value  function  and  is 
such  that  partition  boundaries  are  located  half-way  between  the  condi- 
tional means  of  the  neighboring  partitions. 

If  is  unimodal  the  solution  to  (4.3.16)  will  be  unique. 

Otherwise,  all  the  critical  points  must  be  calculated  in  order  to  iden- 
tify the  partition  that  maximizes  (4.3.11).  Except  for  trivial 
distributions,  solutions  to  (4.3.16)  will  have  to  be  determined  using 
some  sort  of  iterative  technique.  Table  4.2  gives  the  optimal  partition 
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Optimal  Quantizing  Partitions  for  the  Quadratic  Problem 
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boundaries  for  the  normalized  uniform,  exponential  and  normal  distribu- 
tions. The  normal  results  were  obtained  in  another  context  by  Cox  [3]. 
Data  for  the  other  distributions  were  calculated  from  the  results  of 
the  following  two  examples. 


Example:  Uniform  Distribution 

Suppose  that  s is  uniformly  distributed.  Then 


<S'yi-l 


yi5e> 


y.  . + y. 
i-I  ;i 


(4.3.17) 


Substituting  into  (4.3.16)  and  solving  for  y.,  we  get 


yi-i + yi+i 


(4.3.18) 


Th.refore,  the  optimal  partition  for  the  uniform  distribution  is  ob- 
tained by  equally  spacing  the  y^  . 

Example:  Exponential  Distribution 

For  the  exponential  distribution 


f(s)  = e"S  , s > 0 , 


(4.3.19) 


we  have 


yi 


r - -s 


s e ds 


yi-i 


yi 

^ e S ds 


- 1 + 


-yi  -yi-i 

i-ie 


y.e  - v e 

i J •*  - i 


P"yi  _yi-i 
e - e 


yi:i 


(4.3.20) 


Substituting  into  (4.3.16), 


yi  "2 


2 + 


-yi  -yi- 1 

yie  " yi-ie 


W 


-yi+i  -yi 

- yte 


With  a little  algebra  this  may  be  expressed  as 


yi+l  -yi 


- e 


(4.3.21) 
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v yi-i 


t1- 


(yr>'i.i) 


]|1  + ' '2  1 • (4-3-22) 


Consider  first  i = N- 1 and  observe  that  = m . Then,  (4.3.22) 
becomes 


^-l"  yN- 2 r,  " ^yN-l’yN-2^ 


1 - 


J 


(4.3.23) 


Plugging  i = N-2  into  (4.3.22)  and  using  (4.3.23), 

yN-  2 yN-  3 = _ ^■^yN-2"yN-3^"T1  + 1-e  " " ‘ "j 

" L " ^yN-2~yN-l^ 


" ^yN- ryN-2} 


1-e 


Cl  . „~(yN-2"yN-3)l  yN-l"  yN-2 


(4.3.24) 


Using  (4.3.22),  (4.3.23),  and  (4.3.24)  wn  can  calculate  r.he  optimal  y. 
for  various  values  of  N . For  example,  if  N ■ 3 , (4.3.23)  becomes 

(4.3.25) 

which  has  the  solution  y2  - y1  - 1.5936  . Then  using  (4.3.24)  and  the 
fact  that  yQ  * 0 , 


D- 


-(y, 


■yi) 


1. 


■>’l.  1.5936 
c ) 


(4.3.26) 


which  yields  y1  - 1.0176  , y2  » 2.6112  . 

DEPENDENCE  OF  QUANTIZING  LOSS  ON  QUANTIZATION  SCHEME 

From  (4.3.8)  and  the  assumed  linearity  of  our  decision  maker's 
utility  function,  the  quantizing  loss  associated  with  the  partition 
Ps'{Si}i!l  is  given  by 

Hpg)  = 1 (Cs)  * Lx  . (4.  3.27) 

The  quantity  Lj^  defined  by  (4.3.9)  is  a convenient  measure  of  the 
losses  introduced  into  the  problem  due  to  quantization.  It  is  of 
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interest  to  ascertain  the  effect  of  the  number  of  levels  N and  of 
departure."  from  the  optimal  partitions  on  quantizing  loss.  Consider 
the  case  of  a uniformly  distributed  s . Using  (4.3.18)  in  (4.3.9) 


L 


1 


N 

> P.V. 
„ ii 

i-1 


1 

2 


N 

y 

i-i 


i 

N 


(4  3.28) 


We  should  expect  approximately  this  sort  of  dependence  in  general.  In 
fact  if  N is  relatively  large  the  probability  density  does  not  vary 
much  from  one  end  of  a partition  to  the  other  and  is  well  approximated 
by  a density  function  whose  magnitude  over  each  partition  is  a constant 
equal  to  the  mean  of  its  values  at  the  partition  end  points.  If  this 
is  the  case,  the  best  way  of  partitioning  to  a level  2N  is  to  divide 
each  partition  in  half;  it  is  easy  to  see  that  this  will  result  in 
a value  of  for  2N  partitions,  which  is  1/4  the  value  for  N 

partitions . 

In  Table  4.3  values  of  are  given  for  the  three  distributions 

under  their  respective  optimal  partitions  and  under  equiprobable  parti- 
tions. Notice  that, although  the  optimal  partitions  for  the  exponential 
and  normal  distributions  differ  considerably  from  equiprobable  parti- 
tions, the  latter  perform  well,  indicating  that  the  function  1^  is 
quite  flat  in  the  neighborhood  of  its  minimum.  This  is  a fortunate  re- 
sult as  it  implies  that  the  optimal  quantizing  partition  need  not  be 
specified  too  precisely.  A plot  of  the  minimum  versus  N appears 

in  Fig.  4.5.  Notice  that  decreases  rapidly  up  to  about  N * 3 

Beyond  three  quantizing  levels  a unit  increase  in  N causes  a relatively 
small  decrease  in  . This  tells  us  that  most  of  the  value  of  infor- 
mation can  be  obtained  by  using  rough  quantization  to  as  few  as  three 
levels . 


A GRAPHICAL  TECHNIQUE  FOR  DETERMINING  THE  OPTIMAL  QUANTIZING  PARTITION 
We  discuss  here  a graphical  method  for  obtaining  the  optimal  quan- 
tizing partition  for  the  two-variable  quadratic  problem  given  an  arbi- 
trary prior  distribution  f . 

At  the  heart  of  our  method  lies  a technique  for  quickly  and 
accurately  approximating  the  mean  x of  a real  valued  continuous 
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Values  of  the  Quantizing  Loss  Factor 
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LEVELS  FOR  THE  QUADRATIC  PROBLEM 
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random  variable  x . We  suppose  that  x is  described  by  a cumulative 
distribution  function  G and  correspond! ng  probability  density  func- 
tion g which  is  zero  outside  some  (pos  ible  infinite)  range  (a,b)  . 
Then 


x 


f xg(x)  dx  + f xg(x) 
O’"  a 


dx  . 


(4.3.29) 


Substituting 


da  , 


(4.3. 30) 


we  can  replace  the  single  integrals  by  double  integrals, 


b 0 0 

g(x)  dadx  - I g(x)  dodx  . 

0 0 a'  x 


(4.3.31) 


Reversing  the  order  of  integration, 


_ b b 0 r y 

X ■ [ g(x)  dxda  - g(x)  dxda 

0V  cr  '•*- 

,b 

- [1  - G(a)]  d*  - 

0" 

Equation  (4.3.32)  states  that  the  mean  is  equal  to  the  area  lying  be- 
tween the  cumulative  distribution  function  and  unity  in  the  range 
(0,b)  less  the  area  under  the  cumulative  distribution  function  in  the 
range  (a,0)  . If  we  now  translate  the  axis  to  the  right  a distance 
d --that  is,  we  define  a random  variable  x1  ■ x-d  --and  choose  d so 
that  the  difference  between  the  areas  is  zero,  we  must  have  x'»  x-d 
= 0 , or  d * x . This  shows  that  the  mean  of  any  real  valued  con- 
tinuous random  variable  x is  that  point  on  the  x axis  for  which  a 
vertical  line  through  the  point  is  such  that  the  area  to  the  left  under 
the  cumulative  distribution  function  is  equal  to  the  area  to  the  right 
that  is  between  the  cumulative  distribution  function  and  unity. 

Return  now  to  the  problem  of  approximating  the  optimal  quantizing 
partition.  Working  on  a plot  of  the  cumulative  distribution  function, 


G ( y)  d a 


(4.3.32) 
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The  conditional  moan  of  the 


T 


we  begin  by  guessing  a value  for  y ^ . 
region  partitioned  by  (yQ>y^)  , which  we  denote  in  Fig.  4.6  by  x^  , 
is  now  estimated  using  our  graphical  technique.  When  x^  is  properly 
positioned  at  the  conditional  mean,  the  areas  of  the  shaded  regions 
R^  and  Rj  will  oe  equal. 

Next,  a distance  y ^ - x^  is  narked  off  to  the  right  of  the 
point  y^  , and  the  resulting  point  is  called  x^  . If  y7  is  placed 
so  as  to  satisfy  (4.3.16),  x9  will  be  the  conditional  mean  of  the 
region  (yj,y,),  and  we  can  use  the  fact  that  the  areas  R£  and 
must  be  equal  to  aid  us  in  placing  y9  . Continuing  with  this  method, 
all  tho  boundary  point"  through  y ^ may  be  placed.  Finally,  if  y^ 
was  chosen  correctly,  then  the  point  ^ will  be  at  the  conditional 
mean  of  the  .eg ion  (y^  ^y^)  • If  j is  too  far  to  the  left 
[right],  then  the  process  must  be  repeated  using  a larger  [smaller] 
value  for  y^  . 

4.4  DECISION  VARIABLE  DISCRETIZATION 

Just  as  practical  matters  often  lead  to  a quantization  of  the 
state  space,  they  may  also  require  us  to  restrict  the  feasible  deci- 
sion set  to  a class  representable  by  a finite  set  of  parameters. 

Again  the  reasons  for  this  are  primarily  technical.  Numerical  expres- 
sion of  an  optimal  decision  strategy  inherently  results  in  discretiza- 
tion. Also,  the  optimization  can  frequently  be  greatly  simplified  if 
it  is  performed  in  a decision  tree  which  limits  the  possible  decision 
settings  to  some  small  finite  number.  In  fact,  use  of  a digital  com- 
puter  by  its  very  nature  requires  discretization  of  all  continuous 
variables . 

We  are  led,  therefore,  to  the  problem  of  choosing  the  class  of 
alternatives  to  which  our  solution  shall  be  restricted.  As  with  state 
variable  quantization,  the  key  point  to  bear  in  mind  is  that  the  reduc- 
tion in  complexity  to  be  obtained  through  rough  discretization  of  the 
feasible  decision  space  is  obtained  at  a price  of  a reduction  in  per- 
formance. Let  us  pursue  this  topic  by  once  again  considering  the  two- 
state  quadratic  problem. 
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HCURE  4.6  GRAPHICAL  PROCEDURE  FOR  OBTAINING  THE  OPTIMAL  QUANTIZING  PARTITION  FOR  THE  QUADRATIC  PROBLEM 


A-  5 DISCRETIZATION'  IN  THE  TWO  VARIABLE  QUADRATIC  PROBLEM 

We  assume  that  our  decision  maker  is  faced  with  the  two-variable 
quadratic  decision  problem  described  in  Section  4.3.  His  state  of  in- 
formation is  8 . We  wish  to  know  what  economic  loss  will  result  if 
the  decision  maker  uses  the  simplified  model  of  Fig.  4.7  in  which  the 
infinite  decisii  n space  D of  the  complete  model  is  replaced  by  the 
set  of  points  jdj  , . . . . 

Let  d*  denote  the  optimal  decision  setting  for  the  complete 
model  and  let  | be  the  discretization  of  the  decision 

Spjct . Any  d i sc  re  t i za  t ion  which  contains  d*^>  willj  of  course,  result 
m zero  loss.  However,  we  presume  that  at  this  point  in  the  modelling 
process  d*  is  not  precisely  known.  Let  i (D^)  denote  the  expected 
loss  in  payoff  corresponding  to  the  discretization  . Then,  by  ex- 
pans ion , 


!<D"> 


m r-  , . _ _ 

r-  Probability  d^  is  Expected  loss  if  dj 
__  chosen  optimal  by  x is  chosen  optimal 

imp  1 i f ied  model  _ _by  simplified  model  J 

In  the  present  case,  the  maximum  expected  payoff 


.(4.5. i; 


max  v|d,§ 
d 


fq-E(s|g)2 


(4.5.2! 


COMPLETE  MODEL 


SIMPLIFIED  MODEL 


STATE  OF 
INFORMATION 
BECOMES  S 


rlf  D 


BECOMES  8 


<vld  ,S> 


FIGURE  4.7  COMPLETE  DECISION  MODEL  AND  SIMPLIFICATION  RESULTING 
FROM  DISCRETIZATION 
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is  achieved  with 


d*  * - “ E(s (8)  • (4.5.3) 

Defining  d'  * d - d*  as  the  deviation  from  the  optimal  decision  set- 
ting, 

2 

<v|d-d'+d*,g>  - - \ E ( s | S)  2 + \ qd'2  . (4.5.4) 

Thus,  the  expected  loss  in  payof  if  the  decision  variable  is  set  to 

d . is 
i 

'V|d*,g>-  v1d.,S,  - - ± q(d.  - d*)2  . (4.5.5) 

Now  lot  us  explore  the  behavior  of  the  simplified  model.  If 
r 1 M . 

ilt]_  is  the  existing  discretization,  which  setting  dt  will  the 
simplified  model  choose  as  optimal?  Suppose  again  that  d*  is  the 
optimal  decision  in  the  complete  model.  We  will  determine  the  value 
of  d*  , say  x.  , for  which  the  simplified  model  is  indifferent  be- 
tween alternatives  d.  and  d.  , . Setting 

i l+l 


<v|d.,S^  « <v|d.+1,§>  , 


or  using  (4.5.5), 


- \ q(d.-  d*)2  - - \ q(d.+1-  d*)2  , 


(4.5.6) 


(4.5.7) 


we  obtain 


d*  - x. 

l 


d .+  d . . 
i l+l 


(4.5.8) 


Thus,  tbe  simplified  quadratic  model  chooses  the  discretized  decision 
setting  that  lies  nearest  the  true  optimal  value. 

We  may  now  write  mathematical  expressions  for  each  term  on  the 
right-hand  side  of  (4.5.1).  We  assume  that  the  decision  analyst  has 
through  some  means  derived  a prior  distribution  {d*|g}  on  the  opti- 
mal decision  setting  d*  for  the  complete  model.  Then  the  a priori 
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will  bo  chosen  optimal  by  the  simpli- 


probabi lity  that  decision  d ^ 
fied  model  is 


P. 


L 


d +d 

i 


i + 1 


d.  ,+d. 
l- 1 1 

O 


(A. 5.9) 


and  the  expected  lo^s  given  that  u,  is  chosen  optimal  is 


d .+d  . 

i t+L 


r (d.  - d*)"  [d* | Si  , i ■ 1,..,M  , (A. 5. 10) 

‘"Pi  d.  ,+d*.  1 

t-1  i 


where  dQ  and  d^  ^ are  defined  such  that  (dQ+d1)/2  * a , (cJM+tVl+l^2 
= b and  (a,b;  is  the  range  over  which  [d*|S  is  defined.  Using 
the  above,  (A. 5.1)  becomes 


5(Dd} 


. £ 


M 

V 

d.  ,+d*.' 

1*1  l-l  i 


d ,+d  . 

i l+l 


(d.-  d*)^  [d*  |§} 


(A. 5. 11) 


A SPECIAL  CASE 

Before  turning  to  the  question  of  how  the  discretization 
should  be  chosen,  we  shall  present  a special  case  that  appears  to  be 
an  analog  to  the  quantization  problem  of  Section  A.  3.  Suppose  that  the 
uncertainty  in  d*  arises  because  the  particular  value  that  s ob- 
tains is  not  yet  known.  This  would  be  the  case,  for  example,  if  the 
discretized  model  were  being  designed  to  be  used  repeatedly  for  a number 
of  independent  trials.  Then,  since  for  the  complete  model 

d*  - - * s , (A.5.12) 

if  3 * e and  {s|Cl  - f(s)  , 

fd*|g]  “ f(-  ■?  <*>  • (4.5.13) 
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Iii  this  case,  (4.5.11)  becomes 


M 


d +d.  , 

i i+1 


i (dm)  - V • 2 

d 2t 

1-1  i-1  i 


, ^ 2 n 

(d.-d*)  f(-  -3  d*)  dd*  . (4.5.14) 


Defining  the  change  of  variable  s*  = - qd*/t  and  letting  s - -qd  / t 

i i ’ 

th is  may  be  written 


M 


S.+S.  , 

i i+1 


m 2 " - 2 

- - f,  l 

• , s.  +S . 
i-l  i-l  i 


J (s.-s*)  f(s*) 


ds* 


(4.5.15) 


From  (3.2.39)  we  recognize  that  the  term  in  front  of  the  summation  is 
the  value  of  flexibility  on  d divided  by  the  variance  of  s 


1 (Fd) 


Hence , 


where 


*(d”)  - i (Fd)  . L2  , 


L„  - 


M 

n 


s +s.  , 
i i+1 


s.  ,+s: 

i-i  i 


(si-s*)‘ 


f(s)  ds 


(4.5.16) 


(4.5.17) 


(4.5.18) 


OPTIMAL  DISCRETIZATION 

In  view  of  (4.5.11),  we  will  have  an  optimal  discretization  of  the 
decision  space  if  we  choose  the  d^  so  as  to  minimize 


L 


2 


1 

2 


M 


l 


d.+d 

l 


i+1 


! (d.-d*)2 

d.  ,+d;  1 

i-l  i 

2 


{d*|S}  . 


(4.5.19) 
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Differentiating  with  respe  t to  d.  and  sotting  the  result  to  zero, 

we  obtain  a set  of  necessary  c nditions  for  the  optimal  d • 

i ’ 


d. 

L 


d.  ,+d. 

d*  I — — - 


d* 


t i+l 


,s> 


• ,M 


(4.5.20) 


I lie  c p t ina  1 d i sc  re  t i z 1 1 i on  points  iL  a re  the  cond  i t i on  a 1 means  of 
partitions  whose  bound. iiies  are  located  halfway  between  the  conditional 
mean,  of  the  neighboring  partitions  This  is  precisely  the  condition 
satisfied  by  the  conditional  means  of  the  optimal  quantizing  intervals 
defined  by  (4.3.16):  Therefore,  the  same  procedures  used  in  Section 

4.3  for  calculating  good  quantizing  intervals  may  be  used  to  calcu- 
late good  discretizing  schemes.  In  particular,  the  graphical  tech- 
nique is  useful.  The  onlv  difference  between  the  two  problems,  of 
course , is  that  in  the  case  of  state  variable  quantizing  it  is  the  boun- 
caries , the  y^  in  Fig.  4.6,  that  are  important;  in  the  case  of  deci- 
sion d i o c re t i za t ion  it  is  the  conditional  moans,  the  x.  , that  arc 
important . 

Table  4.4  gives  the  optimal  discretizing  points  for  the  normalized 
uneform,  exponential,  and  normal  probability  distributions.  Table  4.5 
gives  values  of  L 2 for  the  three  distributions  under  their  respective 
•ptimal  discretizations  and  for  the  equiprobable  discretization  in 
which  ProbCd.^  - d*  ^ d.)  - 1/M  for  all  i , and  Prob(d*  - = 

Prob(d*  > dj^)  - 1/2M  . The  entries  in  the  first  column  are  identical 
to  those  of  Table  4.3  since  in  the  optimal  case  the  expressions  for 
and  L9  each  reduce  to 

M x. 

mrn  Ll  « min  L2  - (x  - -Cxlx.^  < x < x.,S>)2  [x|g]  , 

i-L  Xi-L 

(4.5.21) 

where 

_ ' x ^ V3>  4 <*lxi  " x <X  g- 

i 2 " > i ■ 1 , . . . ,M  ,(4.5.22) 

We  reach  the  same  qualitative  conclusions  about  the  behavior  of 
as  we  did  about  1^  . The  function  has  a flat  minimum  indicating  that 
optimal  discretizations  need  not  be  precisely  specified.  The  function 
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decreases  rapidly  witli  the  level  M of  discretization  up  to  about 
M * 3 , telling  us  that  most  of  the  value  of  flexibility  can  be  ob- 
tained through  the  use  of  very  rough  discretization. 

4.6  CONCLUSIONS 

Obviously  a good  deal  more  work  has  to  be  done  before  we  gain  a 
thorough  understanding  of  the  effects  of  quantization  on  state  vari- 
ables and  discretization  on  decision  variables.  However,  our  initial 
results  are  quite  encouraging  as  they  seem  to  imply  that  the  common 
technique  of  quantizing  state  variables  is  a highly  effective  method 
for  evaluating  and  utilizing  information.  Similarly,  discretizing 
decision  variables  seems  to  be  a very  practical  method  for  evaluating 
flexibility. 
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CHAPTER  5 

APPLICATION  OF  THE  FLEXIBILITY  CONCEPT  TO  DECISION 
MODEL  DESIGN  AND  ANALYSIS 

The  flexibility  concept  and  the  quadratic  results  of  Chapters  3 
and  4 enable  us  to  expand  a useful  technique  for  decision  model  design 
and  analysis  called  "proximal  analysis."  The  term  proximal  analysis 
is  short  for  "approximate  sensitivity  analysis." 

In  Sections  5.1  and  5.2  a philosophy  of  model  design  is  presented, 
and  the  usefulness  of  sensitivity  analysis  to  this  process  is  briefly 
discussed.  The  expansion  of  proximal  analysis  to  include  the  concept 
of  flexibility  is  the  subject  of  Section  5.3. 

5.1  DESIGN  OF  SIMPLIFIED  MODELS 

in  previous  chapters  we  repeatedly  indicated  that  a decision  maker 
may  wish  to  use  a less  than  complete  decision  model  because  of  the  high 
cost  of  complete  decision  analysis.  Since  there  are  a large  number  of 
alternative  simplifications,  or  alternative  models,  the  question  arises 
as  to  how  to  choose  the  simplified  model  that  is  most  appropriate  for  a 
given  resource  commitment  problem. 

In  theory,  the  problem  of  choosing  between  competing  models  can  be 
solved  using  the  formal  decision  analysis  technique.  Such  an  approach 
involves  defining  a space  of  decision  models,  what  Smallwood  [12]  refers 
to  as  the  "metamodel,"  and  then  choosing  from  that  space  the  particular 
model  and  corresponding  decision  strategy  that  yield  the  highest  ex- 
pected utility  consistent  with  the  beliefs  and  preferences  of  the  deci- 
sion maker.  The  problems  associated  with  such  a formulation,  however, 
preclude  its  practical  use. 

Instead  of  using  formal  analysis,  the  process  of  model  specifica- 
tion is  usually  approached  in  a heuristic  manner.  The  basic  technique 
is  uo  propose  a simplified  model,  using  "rules  of  thumb"  based  upon  ex- 
perience, and  then  to  improve  that  model  until  it  appears  to  capture 
adequately  the  real  system's  perceived  dynamics. 

Therefore,  a good  portion  of  the  model  design  process  consists  of 
what  Demski  [5,  p.  32]  refers  to  as  determining  the  "scanning 
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information"  that  will  indicate  improvements  that  should  be  interpo- 
lated into  the  model.  by  testing  the  current  simplified  model,  the 
decision  analyst  can  often  generate  much  of  the  needed  scanning  infor- 
mation. One  of  the  most  useful  test  techniques  is  sensitivity  analysis. 

5 . 2 SENSITIVITY  ANALYSIS 

In  sensitivity  analysis  the  decision  analyst  tries  to  determine  the 
change  in  the  model's  selection  of  alternative  actions  or  expected  util- 
ity that  would  result  from  a given  change  in  the  model's  assumptions. 
Assumptions  that  produce  small  changes  are  apparently  relatively  insig- 
nificant, while  assumptions  that  produce  considerable  changes  are 
likely  quite  significant.  Significant  assumptions  pertaining  to  model 
structure  should,  of  course,  be  carefully  investigated. 

We  shall  illustrate  the  fundamental  nature  of  sersitivity  analy- 
i with  applications  to  the  simplified  analysis  of  information  and 
flexibility. 

INFORMATION  EVALUATION  USING  SENSITIVITY  ANALYSIS 

Suppose  a businessman  is  analyzing  the  possibility  of  expanding 
his  product  line.  In  determining  the  price  he  will  charge  for  his  new 
product,  he  may  wonder  how  important  it  is  for  him  to  consider  the  wage 
settlement  in  a labor  dispute  that  is  currently  being  negotiated  by 
one  of  his  competitors.  In  other  words,  our  businessman  is  wondering 
whether  the  wages  that  will  be  paid  by  his  competitor  will  be  an  im- 
portant consideration  in  planning  his  own  pricing  strategy. 

In  general,  sensitivity  analysis  may  be  used  to  estimate  the 
value  of  explicitly  including  the  outcome  of  uncertain  information 
variables  into  a model.  Two  basic  sensitivity  calculations  are  neces- 
sary for  the  analysis.  The  first  is  referred  to  as  open- loop  sensitiv- 
_i_ty  anaiys is , and  it  addresses  the  question  of  how  the  value 
resulting  from  a fixed  decision  setting  varies  with  changes  in  state 
variable  settings.  To  illustrate,  consider  the  basic  decision  model 
of  Fig.  1.4.  Suppose  that  the  decision  vector  is  set  to  its  optimum, 

d*  , and  that  the  i*-'1  state  variable  s.  is  set  to  a fixed  value  s 

1 i 

l nder  these  conditions,  the  expected  payoff  of  the  resultant  lottery 
is  given  by 
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<v  | s.  ,d*,£-> 


(5.2.1) 


f ^v[s,d*,e>  fs  ! s ,£}  . 

sf.SJ  1 

Ranging  s^  over  some  specific  set  of  values  indicates  how  the  value 

function  varies  with  the  value  of  s.  . Howard  [8]  refers  to  this  as 

i 

open- loop  sensitivity  analysis  because  the  decision  is  not  altered  as 
the  information  on  the  state  variable  is  introduced. 

The  second  calculation  is  referred  to  as  closed- loop  sensitivity 
analysis . It  addresses  the  question  of  how  the  maximum  value  of  the 
value  function  behaves  as  a function  of  state  variable  settings.  If 
the  iL  state  variable  has  value  s^  , the  maximum  expected  value  of 
the  lottery  is 


<v|s  ,d*(s  .)  ,f  > ■ max  |*  <v  js ,d  ,£>  fs  | s . ,8}  . (5.2.2) 

deD  sf.  S v 1 

Varying  s^  shows  how  the  maximum  payoff  value  varies  with  the  set- 
ting of  the  ith  state  variable. 

Using  the  open-and  closed-loop  sensitivities  the  decision  analyst 
may  estimate  the  value  to  the  decision  maker  of  knowing  the  outcome  of 
st  . Taking  the  difference  between  the  two  quantities  we  obtain  the 
value  of  stochastic  compensation; 

I(st)  - <vjs.,d*(si),e>  - <v|s'‘i,d*,e>  . (5.2.3) 

The  value  of  stochastic  compensation  is  the  maximum  amount  that  an 
expected  value  decision  maker  would  be  willing  to  pay  in  an  uncertain 
environment  to  fix  the  itV|  state  variable  at  s^  . Therefore,  taking 
the  expectation  of  (5.2.3)  with  respect  to  the  distribution  of  s^  , 

<i|e>-  ri(s.)  {s  |e}  , (5.2.4) 

si 

we  obtain  the  maximum  amount  the  decision  maker  would  pay  for  the  reve- 
lation of  s^  before  setting  his  decision  vector. 

FLEXIBILITY  EVALUATION  USING  SENSITIVITY  ANALYSIS 

The  same  ideas  are  involved  in  the  analysis  of  whether  to  include 
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a specific  decision  variable  directly  in  the  model.  Suppose  we  wish 

to  estimate  the  effect  of  obtaining  flexibility  on  decision  variable 

dj  ^ WCi  calculate  the  partially  c losed-  loop  sens i t iv i ty  in  which 

all  decision  variables  but  d^  are  set  to  nominal  or  fixed  optimal 

values  (d-d  )*  while  d.  is  allowed  to  vary  optimally  with  _s  , we 
-J  1 

get 


•A'ls,(d-d  )*,d*(s)  ,e  . = max  vls,(d-d.)*,d.,^  . (5.2.5) 

11  h J J 

Subtracting  the  open- loop  sensitivity  to  the  state  vector  _s  , we  ob- 
tain an  expression  for  the  value  of  partial  stochastic  compensation. 
This  value  is  the  maximum  amount  an  expected  value  decision  maker 
would  be  willing  to  pay  to  set  the  j1-'  decision  variable  to  compen- 
sate for  given  state  variable  outcomes  s : 


F(s)  - -v  Is  , (d-d  ,)^d*(s)  - <vU,d*,£  . (5.2.6) 

Taking  the  expectation  over  _s  , 

-Flf*  - f F(s)  fs|P]  , (5.2.7) 

_s 

we  obtain  the  value  to  the  decision  maker  of  retaining  flexibility  on 
dj  > given  complete  information  on  the  state  variables. 

APPROXIMATIONS  IN  SENSITIVITY  ANALYSIS 

The  above  analysis  has  illustrated  that  the  value  of  information 
computation  and  the  value  of  flexibility  computation  can  be  interpreted 
as  calculations  of  expected  compensation.  The  compensation  function  is 
oofined  as  the  difference  between  the  model's  open-  and  closed- loop 
sensitivities . 

In  the  practical  application  of  sensitivity  analysis,  approximate 
techniques  are  usually  employed  in  the  calculation  of  the  open-  and 
closed- loop  sensitivities.  Such  approximations  make  it  possible  for 
the  decision  analyst  to  obtain,  at  relatively  low  cost,  approximations 
to  the  value  of  information  given  flexibility.  These, in  turn,  provide 
indications  of  the  benefits  of  various  information  system  and  model 
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design  proposals  and,  therefore,  help  to  guide  the  analyst  in  his  model 
development.  Some  practical  simplifications,  including  the  ceteris 
paribus  fashion  in  which  sensitivity  analysis  is  usually  conducted,  are 
illustrated  in  the  ollowing  section. 

5-3  PROXIMAL  ANALYSIS 

A major  problem  associated  with  a complex  decision  model  is  the 
evaluation  of  the  value  lottery  v(s,d),  s e S , dpi).  In  many 
practical  cases  the  number  of  variables  is  so  large  that  the  costs  of 
direct  evaluation  and  even  computer  simulation  become  prohibitive. 

Calculation  of  stochastic  compensation  functions  in  this  case  is  not 
possible. 

A method  which  is  often  useful  for  dealing  with  such  problems, 
termed  "proximal  decision  analysis ,"  has  been  developed  by  Howard  [8]. 

Rice  [11]  has  shown  that  for  the  evaluation  of  complete  information 
given  complete  flexibility  the  conditions  of  the  proximal  model  allow 
deterministic  compensation  functions  to  be  substituted  for  stochastic 
compensation  functions.  We  shall  show  how  this  technique  may  be  ex- 
panded to  provide  an  estimation  of  the  value  of  incomplete  information 
and  flexibility. 

In  its  basic  form  proximal  analysis  assumes  a model  of  the  form 
of  Fig.  1.4  with  unconstrained  continuous  decision  variables,  a smooth 
value  function,  and  a utility  function  that  is  approximately  exponen- 
tial with  a small  or  moderate  degree  of  risk  aversion.  Following 
Howard  and  Rice  we  imagine  that  the  decision  analysis  cycle  has  yielded 
the  following  data,  .irst,  we  suppose  that  the  deterministic  phase  has 
resulted  in  a deterministic  model  relating  outcome  value  to  state  and 
decision  variable  settings.  A probabilistic  phase  is  assumed  to  have 
•upplied  us  with  a vector  of  mean  values  s and  a matrix  of  covari- 
ances among  the  state  variables.  Howard  [8,  p.  511]  suggests  a proce- 
dure for  obtaining  this  data. 

Let 


a 


max  v(s,d; 
d 


(5.3.1) 


denote 


the  optimum  deterministic 


decision  setting  and  suppose  that 
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v(s,d)  is  approximated  by  a second-order  Taylor  series  expansion  about 
the  point  (s^d)  . If  state  and  decision  variable  settings  are  incre- 
mented by  amounts  -3s  and  Ad  from  J and  d,  respectively,  then  the 
approximate  increase  in  v , denoted  Av  , is  (see  Section  3.2)  given 
by 


where 


Av  • b'^  +4  As'W.£  + As’T.Ad  + -i  Ad'Q/\d  , 


-2 

• v 

' s . 's  . ~ 

L 1 J (s,d)_ 


T = 


r 2 
- v 


V 

-s  . dd  . - ..  > 

_ 1 J 


2 

~ V 

, -id.-d. 

L 1 J 


-.1  • 

(s,d)_j 


(5.3.2) 

(5.3.3) 

(5.3.4) 

(5.3.5) 

(5.3.6) 


The  linear  term  in  is  not  present  since 


r * 


(5.3.7) 


OPERAND  PARTIALLY  CLOSED- LOOP  SENSITIVITIES 

We  wish  now  to  find  the  open- loop  sensitivity  of  v to  changes 
in  state  variables  s.^  with  i belonging  to  some  index  set  I . The 
result  is  obtained  from  (5.3.2)  with  Ad  = 0 , as^  ■ 0 , k f.  I 
Using  the  notation  of  Section  3.2, 


Av 


ol 


V^I 


+ 12  ^IWII^I 


(5.3.8) 


gives  the  open -loop  sensitivity. 
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Next  we  shall  calculate  the  partially  closed- loop  sensitivity  in 
which  the  only  decision  variables  that  may  b’  adjusted  are  those  d^ 
with  j in  an  index  set  J . Putting  &r=  and  &1-  equal  to  zero  in 
(5.3.2), 


(5.3.9) 


Setting  the  gradient,  with  respect  to  dj  equal  to  zero,  we  get  an  ex- 
pression showing  how  the  flexible  decision  variables  are  optimally  ad- 
justed in  response  to  changes  in  state  variables: 


'QJJTIJ^I  ‘ 


(5.3.10) 


Substituting  this  expression  into  (5.3.9)  gives  the  partially  closed- 
loop  sensitivity  of  outcome  value  to  state  variable  changes: 


4vci  ■ + 2 - 1 • <5- 5-11) 


open-loop  sensitivity  effect  of  compensation 


We  see,  in  analogy  with  Howard's  results  [8,  Equation  7.4],  that  the 
partially  closed- loop  sensitivity  is  composed  of  terms  representing 
the  open- loop  sensitivity  to  state  variables  plus  terms  that  show  the 
effect  of  compensation. 

THE  EXPECTED  VALUE  OF  DETERMINISTIC  COMPENSATION 

Subtracting  (5.3.8)  from  (5.3.11)  we  get  an  expression  for  the 
value  of  deterministic  compensation  for  the  quadratic  decision  problem: 


Vcomp(fcl> 


2 -ITIJQJJTIJ^I 


(5.3.12) 


The  value  of  deterministic  compensation  tells  us  what  it  would  be  worth 
to  che  decision  maker  in  a completely  deterministic  environment  to  ad- 
just decision  variables  in  response  to  changes  in  state  variables. 

The  expected  value  of  deterministic  compensation  is  obtained  by 
taking  the  expectation  of  (5.3.12)  with  respect  to  the  marginal 


-102- 


probability  distribution  of 


<v  IP 
comp  1 


2 E( 


2traccfTIJQJJTIJE(  As;[asi) 


(5.3.13) 

A comparison  with  (3.2.39)  shows  that  (5.3.13)  is  exactly  the  expected 
value  of  perfect  information  on  s^  given  perfect  flexibility  on  dj 
for  an  expected  value  decision  maker  with  a quadratic  value  function  if 
any  of  the  conditions  of  Corollary  2 are  satisfied. 

Now  suppose  that  all  state  variables  are  adjusted  in  the  sensitiv- 
ity calculations.  The  compensation  function  becomes 


v (,\s)  - 's'T  Q"  t' 
comp  — won  m 


-l- 

NJyJJ1NJ^ 


(5.3.14) 


If  the  junction  E(^s|LSj)  is  available,  the  compound  function 


',con,p[E<'slisI>>  (5-3.15) 


may  be  formed.  Taking  the  expectation  of  (5.3.15)  yields 


^comple'  ’ ElB(^I^I)TNJl!jiTNJE(3Sl^I>'  • (5.3.16) 


which  is  the  expected  value  of  perfect  information  on  _s^  given  per- 
fect flexibility  on  _dj  for  an  expected  value  decision  maker  with  a 
quadratic  value  function  if  any  of  the  conditions  of  Corollary  1 are 
satisfied . 

APPROXIMATING  THE  CVPIGPF  WITH  SENSITIVITY  ANALYSIS 

Howard  [8,  Appendix  B]  gi\ is  a method  for  numerically  evaluating 
— » ^ * T , Q , and  various  conditional  and  unconditional  covariance 
matrices.  Hence,  the  proximal  model  and  the  theorem  and  corollaries 
of  Chapter  3 provide  a means  for  obtaining  an  approximation  to  the  ex- 
pected value  of  information  given  flexibility  for  the  risk  sensitive 
decision  maker  with  a smooth  value  function. 

The  above  results,  however,  show  that  under  certain  conditions  a 
simpler  procedure  may  be  applied.  For  the  purpose  of  illustration, 
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assume  that  the  value  function  for  the  decision  model  contains  two 
state  variables  and  two  decision  variables.  We  wish  to  estimate  the 
value  of  perfect  information  on  s^  given  perfect  flexibility  on  d^  . 
For  the  first  calculation  we  shall  ignore  the  effect  that  kne  fledge  of 
s^  has  on  the  estimation  of  s2  ‘ The  Procetlure  consists  of 

1.  evaluating  deterministic  open-loop  sensitivity  to 
changes  in  the  observable  state  variable  s^  , 

2.  evaluating  deterministic  partially  closed-loop 
sensitivity  ( d9  continuously  optimized)  to  changes 
in  j1  , 

3.  calculating  the  difference  in  these  two  functions, 

Vcor,p(“Sl)  ' 

4.  determining  the  expectation  of  v 

comp 

If  knowledge  of  impacts  the  decision  through  its  effect  on 

the  estimation  of  S£  , this  may  be  included  in  the  approximation  using 
the  following  procedure: 


1.  evaluate  deterministic  open- loop  joint  sensitivity 
to  changes  in  s^  and  S£  , 

2 evaluate  deterministic  partially  closed-loop  joint 
sensitivity  ( d2  continuously  optimized)  to  changes 
in  s^  and  s9  , 


3. 


4. 


5. 


calculate  the  difference  in  these  two  functions, 
Vcomp(iSl’AS2)  ’ 

determine  E(£s2|  iSj)  , the  conditional  mean  of  As^ 
as  a function  of  As^  , 

determine  the  expected  value  of  v [ As,  ,E(  I As-.  ) ] • 

comp  l ' 1 


Implementation  of  this  procedure  could  be  facilitated  by  approximating 
joint  sensitivities  by  quadratic  functions.  A good  approximation  may 
be  expected  provided  that  E[E( As2  | ASj) ] - 0 ; that  is,  the  prior  ex- 
pet tation  is  a zero  shift  in  the  mean  of  the  unobservable  state  variable. 


CHAPTER  6 

SUMMARY,  CONCLUSIONS,  AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 
6.1  SUMMARY  AND  CONCLUSIONS 

The  objective  of  the  thesis  has  been  to  demonstrate  that  the  con- 
cept of  decision  flexibility  may  be  usefully  incorporated  into  the 
decision  analysis  framework.  The  demonstration  has  been  bas<_d  on  one 
possible  definition  of  flexibility  — the  mathematically  precise  defini- 
tion that  was  presented  in  Chapter  1. 

We  feel  confident  that  we  have  achieved  at  least  some  measure  of 
success.  In  Chapter  1,  application  to  the  classical  problem  of  choos- 
ing  plant  flexibility  indicated  that  our  definition  provides  an  analytic 
representation  of  flexibility  that  seems  to  preserve  successfully  in- 
tuitive notions.  A logical  and  consistent  means  for  calculating  the 
value  of  any  combination  of  information  and  flexibility  was  presented 
in  Chapter  2.  By  applying  the  technique  to  a sample  decision  problem, 
we  demonstrated  that  the  concept  might  be  useful  for  generating  insights 
into  problem  structure.  It  was  shown  that  just  as  the  standard  value 
of  information  calculation  could  be  used  to  evaluate  information-gather- 
ing schemes,  the  value  of  information  given  flexibility  could  be  used 
to  evaluate  information  distribution  and  utilization  systems. 

An  exploration  into  the  value  of  information  given  flexibility  for 
quadratic  decision  problems  was  undertaken  in  Chapter  3.  We  obtained  a 
closed-form  expression  for  the  value  of  perfect  information  on  a subset 
of  state  variables  given  perfect  flexibility  on  a subset  of  decision 
variables.  Alternatively,  this  result  may  be  regarded  as  the  solution 
to  the  two- stage  quadratic  decision  problem  in  which  some  decisions  must 
be  made  now,  while  others  may  be  delayed  until  after  the  receipt  of  some 
information.  The  relation  of  the  va*.ue  of  joint  information  to  the  sum 
of  individual  values  of  information  was  clarified  by  the  quadratic  anal- 
ysis. It  was  shown  that  the  first  order  additivity  or  non- additivity  of 
the  value  of  information  is  determined  by  state  variable  correlation. 

To  a first  order  approximation,  if  two  pieces  of  information  are  un- 
correlated, then  the  value  of  obtaining  that  information  simultaneously 
equals  the  sum  of  the  values  of  receiving  each  item  of  information  by 
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itself.  Similarly,  the  first  order  determinant  of  the  additivity  or 
non-additivity  of  the  value  of  flexibility  is  decision  variable  inter- 
action. If  the  value  function  is  additive  in  two  decision  vectors, 
then  to  first  order,  the  value  of  simultaneously  obtaining  flexibility 
on  both  decision  vectors  will  equal  the  sum  of  the  values  of  obtaining 
flexibility  on  each  vector  individually. 

The  results  concerning  quantization  in  Chapter  4 were  indicative 
of  an  important  "rule  of  thumb"  for  decision  analysis.  Most  of  the 
value  of  including  a state  information  variable  or  a flexible  decision 
into  a decision  model  is  achieved  by  using  three  or  more  levels  of 
quantization  in  a decision  tree,  '.he  marginal  gain  of  using  more  than 
four  levels  seems  to  be  small.  The  effect,  while  relatively  clear  for 
independent  state  variables  and  non-interacting  decision  variables, 
tends  t-o  be  obscured  if  the  state  variables  are  highly  correlated  or  if 
the  decision  variables  interact  strongly  with  other  variables  in  the 
model . 

Our  results  demonstrated  that  once  the  number  of  quantizing  and 
discretizing  levels  has  been  chosen,  the  sensitivity  to  the  particular 
quantizing  scheme  is  relatively  small.  If  practical  considerations 
indicate  that  considerable  importance  is  associated  with  small  differ- 
ences in  certain  ranges  of  a state  or  decision  variable,  then,  cer- 
tainly, such  information  should  be  taken  into  account.  In  the  absence 
of  such  information  the  graphical  technique  of  Section  4.3  may  be  em- 
ployed. A good  rule  of  thumb  for  quantizing  a probability  distribution 
is  to  use  roughly  equal  probability  portioning  with  regions  of  high 
probability  density  getting  slightly  more  probability  than  regions  of 
low  probability  density. 

The  computational  difficulty  of  erforming  the  value  of  informa- 
tion given  flexibility  calculations  gives  impetus  to  a search  for 
simplifying  approximations.  The  analysis  of  Chapter  5 showed  that  an 
approximation  to  the  expected  value  of  perfect  information  given  per- 
fect flexibility  could  be  obtained  by  applying  sensitivity  analysis  to 
the  decision  problem's  deterministic  value  model.  This  enables  a de- 
terministic compensation  function  to  be  evaluated.  This  function  is 
then  combined  with  the  conditional  expectation  of  the  state  vector  s 
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given  the  observable  state  variables  _s^  . The  approximation  to  the 
expected  value  of  information  given  flexibility  is  obtained  by  inte- 
grating this  combined  function  over  the  prior  distribution  of  the  ob- 
servable state  variables. 

6 . 2 SUGGESTIONS  FOR  FURTHER  RESEARC n 

In  the  course  of  our  work  a number  of  what  appear  to  be  highly 
productive  avenues  for  research  were  identified.  Unfortunately,  be- 
cause of  time  constraints  these  avenues  were  only  briefly  explored. 

Wo  mention  here  two  main  aLeas  where  we  feel  additional  investigation 
would  prove  highly  fruitful. 

Our  definition  of  flexibility  has  been  shown  to  provide  insight 
and  understanding  into  several  problems.  Application  of  our  defini- 
tion (or  similar  definitions  of  decision  flexibility)  to  other  common 
decision  problems  would  likely  provide  similar  problem  insights.  Con- 
sider, for  example,  an  analysis  of  flexibility  in  the  problem  of  li- 
quidity preference.  Results  might  indicate  problem  characteristics 
that  determine  the  logical  quantity  of  resources  to  be  held  in  reserve 
for  the  purpose  of  meeting  unexpected  opportunities  or  requirements. 

Such  results  would  prove  highly  useful.  For  this  reason,  we  feel  that 
exploration  into  the  concept  of  decision  flexibility  should  be  con- 
t inued . 

Secondly,  there  seems  to  be  potential  for  the  analysis  of  the 
economic  costs  of  discretization  and  quantization.  Analytic  techniques 
for  investigating  the  distortion  caused  by  data  quantization  are 
nearly  as  plentiful  as  the  use  of  quantized  data  systems.  We  have  shown 
that  such  data  distortion  can  be  evaluated  in  precise  economic  terms. 
Such  a result  provides  the  logical  means  for  judging  a quantizing 
scheme  and  an  objective  function  for  the  design  of  optimal  information 
reporting  and  data  processing  systems. 
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APPENDIX  A 

SUMMARY  OF  BASIC  NOTATION 


s * (si sn)  = \ random  vector  describing  the  state  of  Nature. 

■ tIv3  sot  of  conceivable  states  s of  Nature.  Uncertainty  about 
s is  expressed  by  a probability  distribution  defined  on  S . 

S ■ a state  of  experience  or  information  on  w’.iich  probability  as- 
signments are  made. 

£ = the  experience  level  prior  to  the  analysis. 

* the  probability  density  function  describing  the  uncertainty  in 
_s  when  the  state  of  information  is  § . 

_s|g  ',  ■ 1 S {s.gl  = the  expected  value  of  s given  S . 

s - S' 


(l‘l  > • • • >dm)  “ a voc  tor  of  decision  or  actiox  variables  over 
which  a decision  maker  has  direct  control. 


d-d  . 
~ J 


D 

Y 

T> 


the  vector  composed  of  all  decision  variables  but  d^  . 
the  set  of  conceivable  actions, 
a st: t of  possible  information  signals  y . 

an  information  structure  (a  function  from  S to  Y ) which  pro 
duces  the  information  signal  y = -(s)  when  s is  the  true 
state  of  Nature. 


( ‘l 'm)  = an  information  distribution  structure  (a  vector 

of  functions  defined  on  Y ).  Tj(y)  is  the  information  made 
available  for  the  setting  of  the  jth  decision  variable  when 
the  information  signal  is  y . 

= . • • • * a decision  strategy  (a  function  of  y , 

~(y)  , or  the  level  of  experience  3 , whose  domain  is  D ) . 

If  danger  of  confusion  is  minimal  the  function  may  be  abbrev- 
iated d . 

= the  set  of  feasible  decision  strategies. 
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a value  function  (a  real  valued  function  defined  on  S x R ). 
The  monetary  value  to  the  decision  maker  if  he  chooses  action 
d and  the  state  of  Nature  is  _s  , is  v(s,d)  . 

a utility  function  (a  real  valued  function  defined  on  R ). 

The  utility  to  the  decision  maker  of  the  monetary  value  v 
is  u(v)  . 

a profit  function. 

(l,...,n)  ■ the  set  of  state  variable  indices. 

{ 1 , . . . ,m  ( * the  set  of  decision  variable  indices. 

a subset  of  N denoting  the  set  of  indices  corresponding  to 
those  state  variables  on  which  information  is  available.  I 
denotes  the  complement  of  I . 

a subset  of  M denoting  the  set  of  indices  of  decision  vari- 
ables for  which  flexibility  is  available.  J denotes  the  com- 
plement of  J . 

the  matrix  ^ j of  those  elements  t^  of  the  matrix 

T such  that  k is  in  I and  1 is  in  J . 

the  vector  of  state  variables  on  which  perfect  information  is 
available . 

E(s[sl)  * the  conditional  mean  of  js  given  perfect  information 
on  j . 

the  vector  of  decision  variables  for  which  perfect  flexibility 
is  available. 

the  information  structure  for  which  perfect  information  is 
available  or  _s_  and  perfect  flexibility  exists  on  d.  . 

“J 

the  value  of  the  information  structure  Cs,FdT 


APPENDIX  B 

THE  ENTREPRENEUR'S  PRICE-QUANTITY  DECISION 


We  present  here  the  solution  to  the  entrepreneur's  problem  of 
Section  2.2.  An  entrepreneur  plans  to  produce  a new  product  and  wishes 
to  decide  upon  a price  and  quantity  that  will  maximize  his  expected 
profits.  His  problem  would  not  be  too  difficult  if  it  were  not  for 
uncertainty,  but  he  recognizes  thf*-  he  is  uncertain  about  what  his 
costs  will  be  and  about  what  the  demand  for  his  product  will  be. 

We  suppose  that  our  entrepreneur  feels  that  the  demand  for  his 
product  will  be  related  to  the  price  he  charges  according  to 

x * - - b - e , (B.  1) 

P 


where 

x « demand  (in  thousands  of  units)  , 
p * price  per  unit  (in  thousands  of  dollars)  , 
e « a random  variable  uniformly  distributed  from  zero  to  one  , 
a,b  * constants  . 

Suppose,  further,  that  he  feels  his  costs  c per  unit  are  well  repre- 
sented by  a random  variable  uniformly  distributed  between  zero  and 
one: 


c = total  cost  per  unit  (in  thousands  of  dollars)  . 

We  assume  the  random  variables  e and  c are  independently  distributed. 
The  demand  curve  (B.l)  and  the  probability  dersity  function  for  the  de- 
mand parameter  e are  illustrated  in  Fig.  2.4.  The  probability  den- 
sity function  for  the  cost  variable  c is  illustrated  in  Fig.  2.3. 

The  objective  of  our  analysis  is  to  determine  our  entrepreneur's 
optimal  price  and  quantity  and  the  corresponding  expected  net  profit 
under  various  perfect  information  given  perfect  flexibility  structures. 
Let 

q « quantity  of  product  produced  (in  thousands  of  units)  , 
v = net  profit  (in  millions  of  dollars)  . 
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Then , 


v(p,q,c,e) 


$ 


G)  - cq  , 

if 

a , 

— -b-e  ^ q 
P H 

) q , 

if 

a , 

— b-e  '>  q 

(B.  2) 


Suppose  first  that  our  entrepreneur  seeks  no  further  information. 
As  a function  of  price  and  quantity  his  expected  ne"  profit  will  be 

<v|p,q,e>=  f v(p,q,c,e)  felp]  fc!P} 
ck  eJ 

2 2 2 
' % ' (b  + \ + ^)P  + ba  + (a  - hq  - pbq  - £3-  . (B.3) 


= a 


Differentiating  and  setting  the  result  equal  to  zero  we  obtain  expres- 
sions for  the  optimal  price  and  quantity, 


which  yield  a maximal  expected  profit  of 


b , 


(B.  4) 


^!P/>  - ■'vlp*,q*,C>  = a + | - \ /(2bfl)(4a-l)  . (b.5) 

To  be  specific,  let  us  suppose  that  a ■ 2.25  , b * .5  Then 


P*  " 1 " $1,000  , q*  > 1.25  - 1,250  units 
The  expected  demand  is 


B ^ - b - • e|P  . = 1.25  - 1,250  units  , 


and  the  expected  net  profit  is 

|fS  = . 5 = $500,000 


(B.6) 


(B.  7) 


(B.  8) 


We  shall  now  proceed  to  calculate  the  optimal  decision  strategies, 
the  expected  payoffs,  and  the  values  of  the  several  information- 
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distribution  structures  in  which  perfect  information  is  available  on 
various  state  variables  and  flexibility  exists  on  various  decision 
variables.  In  all  there  are  nine  possible  distinct  combinations  of 
state  variable  information  and  decision  variable  flexibility.  Unless 
otherwise  noted,  in  each  of  these  cases  the  optimal  decision  strategy 
is  found  by  differentiation.  By  (2.1.7),  the  values  of  the  information' 
flexibility  structures  (the  entries  of  Table  2.1)  will  be  the  differ- 
ences between  the  expected  profit  under  the  structures  and  Eq.  (B.7). 

Perfect  Information  on  c and  e --  Perfect  Flexibility  on  p and  q 
If  costs  and  demand  are  revealed  to  the  entrepreneur  before  he 
sets  his  price  and  quantity,  then,  obviously,  he  can  expect  to  increase 
his  profits.  In  such  a situation  the  maximal  expected  profit 


<v |CceFpq,C>  - I T max  v(p ,q ,c  ,e)  [e  |P]  fc|e} 


c e 


a+|  + I.|.l/2[(bfl)3/2.  b3/2] 


(B.  9) 


is  obtained  by  setting 


- b - e 


(B. 10) 


(assuming  that  a > b + e so  that  p*  > c ) . With  a 
b - .5  , ''v ICceFpq  = $771,915  . 


2.25  , 


Perfect  Information  on  c --  Perfect  Flexibility  on  p and  q 

Should  costs  alone  be  revealed  prior  to  the  setting  of  p and  q, 


<v  jCcFpq  ,£>  = i max  f v(p,q,c,e)  fe  If,}  jc  |?.} 

c*  p,q  e' 


a + | - /2b+l  [ J 

* O’ 


2ac-c  dc 


3 +|  - 


'J  2b+l 


j^(l-a)  + arsin'1  ^ + -£) 
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(B. 11) 


is  attained  with 


( 2a- c)r 
2b-*-  i 


/ 2b+l 

y (2a-c)c 


q*  = (a-c)  . r~  - b . 


(B.12) 


With  the  example  values  a = 2.25  , b=.5,  ■ v CcFpq,£>  = $6  39,416. 


Perfect  Information  on  e --  Perfect  Flexibility  on  p and  q 

Should  the  demand  parameter  e be  revealed  prior  to  the  setting 
of  p and  q , 

^vlCerpq,e-»  f max  ^vCp.q.c.e)  fc  |£  ’■  re  1 6* 
e'  p,q  c 

= a + % + - - r(M-l)3/2-  b3/-  ] , (B.  1 3) 


and  the  optimal  decision  strategy  is 


P*  m\  2(jb*c)  ’ q*-/2^*0  -b-" 


With  a = 2.25  , b ■ .5  , ^ JCeFpq  - $651,924 


(B . 14) 


Perfect  Information  on  c and  e --  Perfect  Flexibility  on  p 

If  perfect  information  on  costs  and  demand  is  used  only  for  the 
setting  of  price, 


•'V  CccFp  ,£"> 


max  ' f max  v(p,q,c,e)  ole'*  fdp} 
q c”  o'  p 


■ max 

q 


(B . 15) 


The  optimal  pricing  strategy  sets  p at  the  highest  value  that  will 
sell  out  the  entire  production  quantity. 


q-fb+o 


(B. 16) 


With  the  parameter  values  a = 2.25  , b ■ .5  , the  maximixing  q in 


-113- 


IT 


(B. 15)  is  approximately  q*  * 1.0947  , and  this  yields  an  expected 
profit  of  <v  |CceFp,P">=  $651,639  . 

Unlike  the  other  optimal  strategies,  if  our  entrepreneur  chooses 
this  information- flexibility  structure,  it  is  conceivable  that  he  will 
lose  money!  In  the  worst  possible  outcome, demand  will  be  at  its  lowest 
(e  * 1)  and  costs  will  be  at  their  highest  (c  ■ 1)  conceivable  values. 
The  pricing  strategy  (B.16)  puts  p*  * $867.15:  our  entrepreneur 

will  lose  $132.85  on  each  of  the  1,095  units  he  sells. 

Perfect  Information  on  c and  e --  Perfect  Flexibility  on  q 

If  perfect  information  on  costs  and  demand  is  used  only  for  the 
setting  of  quantity, 


<v  (CcoFq  ,£  > * max  f j max  v(p,q,c,e)  fc|£]  fc|£] 


P c* 


- a + - + \ - %/a(2brf  1)  , 


(B . 17) 


a 

2H-1 


, q*  = v/a(2b+l)  - b - 


(B. 18) 


It  is  assumed  in  (B.17)  and  (B.18)  that  a > 2b+l  so  that  costs  may 
not  exceed  p*  . With  the  values  a * 2.25  , b ■ .5  , 'v|CceFq,£>  * 
$628,680  . 

Perfect  Information  on  c --  Perfect  Flexibility  on  p 

Suppose  our  entrepreneur  will  have  perfect  information  on  costs  but 
uses  that  information  only  in  the  setting  of  his  price.  Then, 


-v  ICcFp ,£  > * max  ^ max  j*  v(p,q,c,c)  fe  |f.}  fc|£} 
q c p e ' 


a + | - \ y (2b+l) (4a- 1)  , 


(B. 19) 


1 4a- 1 
8W-4 


(2a- 1) 


' 2bfl 
4a- 1 


(B . 20) 
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Comparison  of  (B.19)  and  (B.20)  with  (B.5)  and  (B.4)  shows  that  knowledge 
of  c does  not  aid  in  the  setting  of  p . While  knowing  costs  will  im- 
prove our  entrepreneur's  estimate  of  his  expected  profits,  it  does  not 
help  him  to  improve  his  pricing  strategy.  For  this  reason  there  is  no 
economic  advantage  to  seeking  information  on  costs  if  this  information 
cannot  be  used  for  the  setting  of  quantity. 

Perfect  Information  on  c --  Perfect  Flexibility  on  q 

Suppose  the  information  on  costs  is  used  only  for  the  setting  of 
quantity.  Then, 


'v|CcFq,e  - = max  I ma\  J v(p,q,c,e)  fe |€ } fc  |e } 


pc  q e 
2 

3 a 


8 (3b4-2)  ’ 


(B*  21) 


3a 

P*  " 


if  c . 


I 0 • 

j 6b+4  . 

s—  (a-c)  - b - c , otherwise 


3a 

6b+4 


(B. 22) 


Since  quantity  may  be  conditioned  upon  costs,  if  costs  turn  out  to  ex- 
ceed his  selling  price  the  entrepreneur  chooses  not  to  produce  his 
product.  With  the  example  values  of  a = 2.23  , b = .5  , (B.21)  be- 
comes -•'V  ICcFq ,£■>  - $542,411  . 


Perfect  Information  on  e — Perfect  Flexibility  on  p 

Should  our  entrepreneur  anticipate  knowing  demand  before  he  sets 
his  price,  his  expected  profit  is 

''v|CoFp,g\,  » max  1 max  v(p,q,c,e)  'c  |f ! fe|^l 
q e pc’ 


■ max 

q 


(B. 23) 


and  his  optimal  pricing  strategy  is 
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q+b+> 


(B. 24) 


These  are  the  same  results  we  obtained  in  the  calculations  under  the 
structure  CceFp  . We  conclude,  therefore,  that  of  the  knowledge  c , e 
it  is  only  the  knowledge  of  e that  has  economic  value. 


Perfect  Information  on  e --  Perfect  Flexibility  on  q 

Lastly,  we  suppose  that  our  entrepreneur  will  receive  perfect 
information  on  demand  but  may  use  that  information  only  for  his  set- 
ting of  quantity.  Then, 


'v  |CeFq  ,£> 


max  P max  f v(p,q,c,e)  (cl£)  fele] 
p ec  q cJ 


- a + | + | - /a(2bfl)  , 


(B. 25) 


q*  - ya(2b+l)  - b - e . 


(B. 26) 


This  corresponds  to  (B . 17)  and  (B.18).  As  far  as  setting  quantity  is 
concerned,  the  economic  value  of  knowledge  of  costs  and  demand  is 
achieved  through  knowledge  of  demand  alone. 
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